Jul 01 19:16:10.093547 ip-10-0-143-127 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 19:16:10.093558 ip-10-0-143-127 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 19:16:10.093566 ip-10-0-143-127 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 19:16:10.093831 ip-10-0-143-127 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 19:16:20.206869 ip-10-0-143-127 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 19:16:20.206884 ip-10-0-143-127 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1dc9f91068cc4b94b2e067cb19f88b13 -- Jul 01 19:18:19.053883 ip-10-0-143-127 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:18:19.452834 ip-10-0-143-127 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:18:19.452834 ip-10-0-143-127 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:18:19.452834 ip-10-0-143-127 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:18:19.452834 ip-10-0-143-127 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:18:19.452834 ip-10-0-143-127 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:18:19.453638 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.453535 2551 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:18:19.457849 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457833 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:19.457849 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457849 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457853 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457857 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457860 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457863 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457866 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457869 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457872 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457875 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457878 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457880 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457883 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457885 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457888 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457891 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457896 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457899 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457901 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457904 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457907 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:19.457914 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457915 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457918 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457921 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457924 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457927 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457930 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457932 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457935 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457938 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457941 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457943 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457946 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457949 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457953 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457957 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457960 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457963 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457966 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457968 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:19.458380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457973 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457976 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457978 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457980 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457983 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457985 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457988 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457991 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457993 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457995 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.457998 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458001 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458003 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458006 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458009 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458013 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458015 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458018 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458021 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458023 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:19.458885 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458026 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458030 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458034 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458037 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458040 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458042 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458044 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458047 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458051 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458055 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458057 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458061 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458063 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458066 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458069 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458071 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458074 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458076 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458079 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:19.459391 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458081 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458084 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458087 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458089 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458092 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458094 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458097 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458100 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458104 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458107 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458109 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458112 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458114 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458117 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458120 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458122 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458126 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458128 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458131 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458133 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:19.459880 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458920 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458928 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458932 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458935 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458939 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458942 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458945 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458948 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458950 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458953 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458955 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458958 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458961 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458963 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458966 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458969 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458972 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458975 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458977 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458980 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:19.460380 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458984 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458987 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458990 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458993 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458996 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.458998 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459001 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459003 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459006 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459008 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459011 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459014 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459017 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459019 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459021 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459024 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459028 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459031 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459035 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:19.460892 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459037 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459040 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459043 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459046 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459048 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459051 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459053 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459056 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459060 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459064 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459066 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459069 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459073 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459077 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459081 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459084 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459087 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459091 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459095 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:19.461357 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459098 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459100 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459103 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459106 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459109 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459113 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459115 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459118 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459121 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459123 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459126 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459128 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459131 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459134 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459137 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459139 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459142 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459144 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459148 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459150 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:19.461833 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459153 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459156 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459159 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459161 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459164 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459167 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459169 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459172 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459174 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459177 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459180 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459182 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459185 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459188 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459190 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459193 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459195 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459198 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459200 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459203 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:19.462320 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459206 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459603 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459608 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459611 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459613 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459616 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459619 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459621 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459626 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459630 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459633 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459636 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459639 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459642 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459645 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459649 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459651 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459654 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459656 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:19.462820 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459659 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459661 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459665 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459667 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459670 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459672 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459675 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459677 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459680 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459683 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459685 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459688 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459690 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459701 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459706 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459709 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459711 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459714 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459716 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:19.463296 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459719 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459722 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459725 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459728 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459730 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459734 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459737 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459740 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459744 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459747 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459750 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459753 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459755 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459758 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459761 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459763 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459767 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459770 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459773 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:19.463781 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459775 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459778 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459780 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459783 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459785 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459788 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459791 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459793 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459796 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459799 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459802 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459804 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459807 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459809 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459812 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459814 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459817 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459819 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459822 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459824 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459831 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:19.464275 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459833 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459836 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459839 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459841 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459844 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459846 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459851 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459853 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459856 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459860 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459862 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459865 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459868 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459870 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459873 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459875 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459878 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459881 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459883 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459886 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:19.464787 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459889 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.459892 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.459969 2551 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.459977 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.459983 2551 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.459988 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.459992 2551 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.459995 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.459999 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460004 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460007 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460011 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460015 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460018 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460021 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460024 2551 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460027 2551 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460030 2551 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460034 2551 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460037 2551 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460042 2551 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460045 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460048 2551 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:18:19.465263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460051 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460055 2551 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460059 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460062 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460065 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460068 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460071 2551 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460074 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460078 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460081 2551 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460083 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460088 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460091 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460094 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460097 2551 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460100 2551 flags.go:64] FLAG: --enable-server="true" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460103 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460108 2551 flags.go:64] FLAG: --event-burst="100" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460111 2551 flags.go:64] FLAG: --event-qps="50" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460114 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460119 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460122 2551 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460125 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460128 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460132 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:18:19.465816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460135 2551 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460138 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460142 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460145 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460148 2551 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460151 2551 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460154 2551 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460158 2551 flags.go:64] FLAG: --feature-gates="" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460162 2551 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460165 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460168 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460171 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460174 2551 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460177 2551 flags.go:64] FLAG: --help="false" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460180 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460183 2551 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460186 2551 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460189 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460192 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460195 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460198 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460201 2551 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460203 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:18:19.466483 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460206 2551 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460209 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460212 2551 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460215 2551 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460219 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460222 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460225 2551 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460228 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460231 2551 flags.go:64] FLAG: --lock-file="" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460233 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460237 2551 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460241 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460246 2551 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460249 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460252 2551 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460255 2551 flags.go:64] FLAG: --logging-format="text" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460258 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460261 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460264 2551 flags.go:64] FLAG: --manifest-url="" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460267 2551 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460274 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460277 2551 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460281 2551 flags.go:64] FLAG: --max-pods="110" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460284 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460287 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:18:19.467454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460290 2551 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460293 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460296 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460299 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460302 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460309 2551 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460312 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460315 2551 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460318 2551 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460321 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460327 2551 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460330 2551 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460334 2551 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460337 2551 flags.go:64] FLAG: --port="10250" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460340 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460343 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ceb8517a9ae173c2" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460346 2551 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460349 2551 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460353 2551 flags.go:64] FLAG: --register-node="true" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460356 2551 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460360 2551 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460362 2551 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460365 2551 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460368 2551 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460372 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:18:19.468472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460375 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460378 2551 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460381 2551 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460384 2551 flags.go:64] FLAG: --runonce="false" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460387 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460391 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460394 2551 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460397 2551 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460399 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460403 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460406 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460409 2551 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460412 2551 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460415 2551 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460417 2551 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460420 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460423 2551 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460426 2551 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460429 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460435 2551 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460438 2551 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460441 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460445 2551 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460448 2551 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460451 2551 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:18:19.469192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460454 2551 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460457 2551 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460460 2551 flags.go:64] FLAG: --v="2" Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460464 2551 flags.go:64] FLAG: --version="false" Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460467 2551 flags.go:64] FLAG: --vmodule="" Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460471 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460475 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460608 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460613 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460616 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460619 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460622 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460625 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460628 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460631 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460633 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460636 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460638 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460641 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460643 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460645 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460648 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:19.469813 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460650 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460653 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460656 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460658 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460662 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460666 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460670 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460673 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460676 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460679 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460681 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460684 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460687 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460689 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460691 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460694 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460696 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460699 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460701 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460704 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:19.470355 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460707 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460709 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460712 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460715 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460717 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460720 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460722 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460724 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460727 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460730 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460732 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460735 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460737 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460740 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460743 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460745 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460748 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460750 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460753 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460755 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:19.470860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460758 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460760 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460763 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460765 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460767 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460770 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460772 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460775 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460779 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460782 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460785 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460788 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460791 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460794 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460797 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460799 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460802 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460804 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460807 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:19.471356 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460809 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460812 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460814 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460817 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460819 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460823 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460826 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460829 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460832 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460835 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460837 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460840 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460842 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460845 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460847 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460850 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460853 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460855 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460857 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:19.471907 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460860 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460862 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460865 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460867 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460871 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.460874 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.460879 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.469887 2551 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.469907 2551 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.469926 2551 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.469932 2551 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.469998 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470004 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470008 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470011 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:19.472362 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470014 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470017 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470021 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470024 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470027 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470030 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470033 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470036 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470040 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470044 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470052 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470055 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470059 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470061 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470065 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470067 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470070 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470073 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470075 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470078 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:19.472772 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470080 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470083 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470086 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470089 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470091 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470095 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470097 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470100 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470103 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470106 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470109 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470112 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470114 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470117 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470119 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470122 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470125 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470127 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470130 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470133 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:19.473253 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470135 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470138 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470146 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470149 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470152 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470154 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470157 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470160 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470162 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470165 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470167 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470170 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470172 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470175 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470177 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470180 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470182 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470186 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470189 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470191 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:19.473834 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470194 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470197 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470201 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470204 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470207 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470211 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470213 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470216 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470219 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470222 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470225 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470228 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470231 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470233 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470236 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470246 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470248 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470251 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470254 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:19.474326 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470256 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470259 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470261 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470264 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470266 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470269 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470273 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470276 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470279 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470281 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470284 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470288 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470290 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470293 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470296 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:19.474909 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470299 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.470304 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470435 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470440 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470443 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470446 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470449 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470452 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470456 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470460 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470463 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470466 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470469 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470471 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:18:19.475274 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470475 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470478 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470480 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470483 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470487 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470490 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470494 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470496 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470499 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470502 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470505 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470508 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470510 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470515 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470518 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470521 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470524 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470527 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470529 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:18:19.475636 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470532 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470534 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470537 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470540 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470543 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470546 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470548 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470551 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470553 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470556 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470558 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470561 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470563 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470566 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470569 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470572 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470574 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470610 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470613 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470616 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:18:19.476098 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470619 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470622 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470624 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470627 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470629 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470632 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470635 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470638 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470641 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470644 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470647 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470650 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470654 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470657 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470659 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470662 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470665 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470667 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470670 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470672 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:18:19.476590 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470675 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470677 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470680 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470682 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470685 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470687 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470690 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470693 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470696 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470699 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470701 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470704 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470706 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470709 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470711 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470714 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470716 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470719 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470722 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470724 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:18:19.477079 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470727 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470730 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470732 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470735 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470737 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470740 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470742 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:19.470745 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.470751 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.470902 2551 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.473415 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.474773 2551 server.go:1019] "Starting client certificate rotation" Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.474868 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:18:19.477571 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.474904 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:18:19.477952 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.477795 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:18:19.479343 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.479313 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:18:19.488932 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.488914 2551 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:18:19.491057 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.491043 2551 log.go:25] "Validated CRI v1 image API" Jul 01 19:18:19.492319 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.492301 2551 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:18:19.496800 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.496772 2551 fs.go:135] Filesystem UUIDs: map[04b43470-1b4b-4c43-9f15-062e19f1acde:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d46411d7-80a9-4255-92e9-6877f81bb5ce:/dev/nvme0n1p4] Jul 01 19:18:19.496887 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.496799 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:18:19.504245 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.504125 2551 manager.go:216] Machine: {Timestamp:2026-07-01 19:18:19.502837443 +0000 UTC m=+0.335276715 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096897 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2609d8d0e16ef5e4a0c720730c7c1b SystemUUID:ec2609d8-d0e1-6ef5-e4a0-c720730c7c1b BootID:1dc9f910-68cc-4b94-b2e0-67cb19f88b13 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:84:53:b6:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:84:53:b6:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:20:3d:b9:27:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:18:19.504245 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.504236 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:18:19.504400 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.504327 2551 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:18:19.506965 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.506935 2551 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:18:19.507104 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.506967 2551 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-127.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:18:19.507659 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.507648 2551 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:18:19.507710 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.507661 2551 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:18:19.507710 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.507669 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:18:19.508088 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.508064 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:18:19.508440 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.508427 2551 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:18:19.509232 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.509222 2551 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:18:19.512021 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.512006 2551 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:18:19.512163 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.512153 2551 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:18:19.512199 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.512186 2551 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:18:19.512231 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.512199 2551 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:18:19.512231 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.512217 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:18:19.512231 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.512227 2551 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:18:19.512324 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.512237 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:18:19.512745 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.512733 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:18:19.512789 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.512753 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:18:19.515008 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.514989 2551 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:18:19.516553 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.516539 2551 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:18:19.516616 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.516571 2551 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:18:19.516770 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.516760 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:18:19.516799 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.516776 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:18:19.516799 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.516782 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:18:19.516799 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.516787 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:18:19.516799 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.516798 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:18:19.516943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.516806 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:18:19.517221 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.517213 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:18:19.517250 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.517223 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:18:19.517250 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.517230 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:18:19.517250 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.517236 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:18:19.517250 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.517244 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:18:19.517347 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.517252 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:18:19.518068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.518056 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:18:19.518068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.518067 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:18:19.521619 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.521605 2551 server.go:1268] "Started kubelet" Jul 01 19:18:19.521728 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.521688 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:18:19.521954 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.521900 2551 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:18:19.522056 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.521975 2551 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:18:19.523071 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.523052 2551 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:18:19.523220 ip-10-0-143-127 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:18:19.523519 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.523499 2551 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-127.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:18:19.523519 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.523504 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:18:19.523650 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.523576 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:18:19.525795 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.525774 2551 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:18:19.528486 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.528462 2551 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:18:19.528486 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.525954 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-127.ec2.internal.18be409249203735 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-127.ec2.internal,UID:ip-10-0-143-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-127.ec2.internal,},FirstTimestamp:2026-07-01 19:18:19.521546037 +0000 UTC m=+0.353985284,LastTimestamp:2026-07-01 19:18:19.521546037 +0000 UTC m=+0.353985284,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-127.ec2.internal,}" Jul 01 19:18:19.529744 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.529728 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:18:19.529744 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.529737 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:18:19.529877 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.529858 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:19.530529 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530507 2551 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:18:19.530529 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530505 2551 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:18:19.530703 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530536 2551 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:18:19.530703 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530561 2551 factory.go:55] Registering systemd factory Jul 01 19:18:19.530703 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530577 2551 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:18:19.530703 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530669 2551 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:18:19.530703 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530680 2551 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:18:19.530911 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530812 2551 factory.go:153] Registering CRI-O factory Jul 01 19:18:19.530911 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530823 2551 factory.go:223] Registration of the crio container factory successfully Jul 01 19:18:19.530911 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530875 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:18:19.530911 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530894 2551 factory.go:103] Registering Raw factory Jul 01 19:18:19.530911 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.530904 2551 manager.go:1196] Started watching for new ooms in manager Jul 01 19:18:19.531280 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.531266 2551 manager.go:349] Starting recovery of all containers Jul 01 19:18:19.531710 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.531680 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 19:18:19.531836 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.531814 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 19:18:19.533037 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.532963 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8nnc9" Jul 01 19:18:19.541215 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.541181 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8nnc9" Jul 01 19:18:19.541399 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.541382 2551 manager.go:354] Recovery completed Jul 01 19:18:19.546291 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.546277 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:19.548212 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.548194 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:19.548295 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.548222 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:19.548295 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.548232 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:19.548810 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.548788 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:18:19.548810 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.548804 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:18:19.548961 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.548819 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:19.548961 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.548824 2551 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:18:19.549524 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.549511 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:19.549619 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.549539 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:19.549619 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.549550 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:19.550063 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.550050 2551 policy_none.go:49] "None policy: Start" Jul 01 19:18:19.550117 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.550067 2551 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:18:19.550117 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.550079 2551 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:18:19.551044 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.551035 2551 policy_none.go:47] "Start" Jul 01 19:18:19.589339 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.589317 2551 manager.go:337] "Starting Device Plugin manager" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.589409 2551 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.589423 2551 server.go:87] "Starting device plugin registration server" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.589774 2551 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.589787 2551 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.589881 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.589969 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.589978 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.590533 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.590597 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.595654 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.596917 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.596951 2551 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.596970 2551 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.597000 2551 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:18:19.599786 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.599450 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:19.690045 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.690001 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:19.691125 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.691108 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:19.691225 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.691140 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:19.691225 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.691151 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:19.691225 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.691173 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.697764 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.697746 2551 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal"] Jul 01 19:18:19.697846 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.697812 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:19.698639 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.698613 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:19.698639 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.698644 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:19.698811 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.698658 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:19.699969 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.699952 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.700058 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.699974 2551 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-127.ec2.internal\": node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:19.700117 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.700096 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:19.700238 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.700216 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.700283 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.700257 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:19.700833 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.700817 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:19.700910 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.700848 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:19.700910 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.700858 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:19.700910 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.700822 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:19.701028 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.700931 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:19.701028 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.700944 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:19.702066 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.702048 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.702160 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.702077 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:18:19.702780 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.702767 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:18:19.702873 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.702793 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:18:19.702873 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.702805 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:18:19.722178 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.722157 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-127.ec2.internal\" not found" node="ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.726096 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.726082 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-127.ec2.internal\" not found" node="ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.731819 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.731804 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:19.831920 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.831885 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6f9277c0ee99ce2a328a582777cf411-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal\" (UID: \"b6f9277c0ee99ce2a328a582777cf411\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.832033 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.831937 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6f9277c0ee99ce2a328a582777cf411-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal\" (UID: \"b6f9277c0ee99ce2a328a582777cf411\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.832033 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.831957 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2884d80ef841c6fbcfc2434aecfb3b35-config\") pod \"kube-apiserver-proxy-ip-10-0-143-127.ec2.internal\" (UID: \"2884d80ef841c6fbcfc2434aecfb3b35\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.832033 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.831898 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:19.932829 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:19.932799 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:19.932907 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.932851 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6f9277c0ee99ce2a328a582777cf411-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal\" (UID: \"b6f9277c0ee99ce2a328a582777cf411\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.932907 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.932880 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6f9277c0ee99ce2a328a582777cf411-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal\" (UID: \"b6f9277c0ee99ce2a328a582777cf411\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.932982 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.932908 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2884d80ef841c6fbcfc2434aecfb3b35-config\") pod \"kube-apiserver-proxy-ip-10-0-143-127.ec2.internal\" (UID: \"2884d80ef841c6fbcfc2434aecfb3b35\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.932982 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.932948 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2884d80ef841c6fbcfc2434aecfb3b35-config\") pod \"kube-apiserver-proxy-ip-10-0-143-127.ec2.internal\" (UID: \"2884d80ef841c6fbcfc2434aecfb3b35\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.932982 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.932963 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b6f9277c0ee99ce2a328a582777cf411-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal\" (UID: \"b6f9277c0ee99ce2a328a582777cf411\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" Jul 01 19:18:19.933085 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:19.932963 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6f9277c0ee99ce2a328a582777cf411-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal\" (UID: \"b6f9277c0ee99ce2a328a582777cf411\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" Jul 01 19:18:20.025910 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.025722 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" Jul 01 19:18:20.028271 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.028250 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal" Jul 01 19:18:20.033929 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:20.033910 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:20.134427 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:20.134393 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:20.234857 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:20.234826 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:20.335330 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:20.335242 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:20.435751 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:20.435702 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:20.474901 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.474862 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:18:20.475348 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.475024 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:18:20.536403 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:20.536372 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:20.545666 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.545624 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:13:21 +0000 UTC" deadline="2028-02-10 03:54:17.925874468 +0000 UTC" Jul 01 19:18:20.545666 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.545659 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14120h35m57.380218464s" Jul 01 19:18:20.562190 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.562166 2551 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:20.593224 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.593152 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:20.636760 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:20.636732 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:20.638218 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:20.638187 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2884d80ef841c6fbcfc2434aecfb3b35.slice/crio-ed06c572ea020a1d90a0113a029c357bfe11ea4bf4d9ac1eca8649565269ce62 WatchSource:0}: Error finding container ed06c572ea020a1d90a0113a029c357bfe11ea4bf4d9ac1eca8649565269ce62: Status 404 returned error can't find the container with id ed06c572ea020a1d90a0113a029c357bfe11ea4bf4d9ac1eca8649565269ce62 Jul 01 19:18:20.638698 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:20.638676 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f9277c0ee99ce2a328a582777cf411.slice/crio-b0060a83d34c324d4abeb03734bcee7a63b4a2588b0ebc3b06979989650996bf WatchSource:0}: Error finding container b0060a83d34c324d4abeb03734bcee7a63b4a2588b0ebc3b06979989650996bf: Status 404 returned error can't find the container with id b0060a83d34c324d4abeb03734bcee7a63b4a2588b0ebc3b06979989650996bf Jul 01 19:18:20.643218 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.643202 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:18:20.737676 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:20.737622 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:20.838026 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:20.837975 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-127.ec2.internal\" not found" Jul 01 19:18:20.919192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.919100 2551 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:20.930365 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.930338 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" Jul 01 19:18:20.949649 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.949619 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:18:20.950593 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.950560 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal" Jul 01 19:18:20.957899 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:20.957876 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:18:21.513915 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.513882 2551 apiserver.go:52] "Watching apiserver" Jul 01 19:18:21.522688 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.522662 2551 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:18:21.523165 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.523137 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w","openshift-cluster-node-tuning-operator/tuned-fr8hq","openshift-multus/multus-7kckl","openshift-multus/multus-additional-cni-plugins-97zfk","openshift-network-diagnostics/network-check-target-rbkmp","openshift-network-operator/iptables-alerter-wg5g5","openshift-ovn-kubernetes/ovnkube-node-ggrjp","kube-system/global-pull-secret-syncer-rcmnr","kube-system/konnectivity-agent-hc87r","openshift-dns/node-resolver-ntmhl","openshift-image-registry/node-ca-s4knf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal","openshift-multus/network-metrics-daemon-dp5wv"] Jul 01 19:18:21.524727 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.524707 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:21.525886 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.525863 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:21.526904 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.526887 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.527630 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.527564 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:21.527630 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.527576 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:18:21.527630 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.527606 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hw7md\"" Jul 01 19:18:21.527928 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.527907 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:21.528029 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.527969 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.528832 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.528611 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tf2d8\"" Jul 01 19:18:21.528832 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.528659 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:18:21.528832 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.528670 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:18:21.529222 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.529168 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:21.529334 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.529313 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p97tn\"" Jul 01 19:18:21.529914 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.529658 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:18:21.529914 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.529675 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:18:21.529914 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.529862 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:18:21.530348 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.530329 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:21.530415 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.530388 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-skph4\"" Jul 01 19:18:21.530415 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:21.530394 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:21.530597 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.530562 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:18:21.531022 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.530874 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:18:21.531022 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.530928 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:18:21.531165 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.531116 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:18:21.531403 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.531384 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wdvdl\"" Jul 01 19:18:21.531500 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.531436 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:21.531550 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:21.531495 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:21.531748 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.531727 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:18:21.531828 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.531769 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:18:21.532692 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.532677 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:21.532776 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:21.532739 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:21.534465 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.534445 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:21.535821 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.535786 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:21.536751 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.536734 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:18:21.537305 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.537284 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:18:21.537399 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.537292 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:21.537683 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.537663 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:18:21.538276 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.538257 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jg89v\"" Jul 01 19:18:21.538353 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.538266 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:18:21.538654 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.538635 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:18:21.538730 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.538690 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6hhsf\"" Jul 01 19:18:21.538785 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.538731 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:21.539842 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.539824 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:18:21.539925 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.539847 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:18:21.539925 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.539880 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:18:21.541222 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541202 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:18:21.541310 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541234 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:18:21.541310 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541269 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:18:21.541310 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541293 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:18:21.541465 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541236 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4r4c5\"" Jul 01 19:18:21.541514 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541498 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:18:21.541610 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541575 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:18:21.541729 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541599 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-var-lib-cni-multus\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.541793 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541774 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-modprobe-d\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.541851 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541635 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n6xbz\"" Jul 01 19:18:21.541851 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541809 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-kubernetes\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.541851 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541832 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-lib-modules\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.541851 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541661 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:18:21.542046 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541857 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:21.542046 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541901 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6139918-9a98-4858-a206-ba8972b3a041-host-slash\") pod \"iptables-alerter-wg5g5\" (UID: \"d6139918-9a98-4858-a206-ba8972b3a041\") " pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:21.542046 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541931 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-system-cni-dir\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:21.542046 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541960 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-cnibin\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:21.542046 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.541987 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-sysconfig\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.542046 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542009 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-sysctl-conf\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.542046 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542031 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-multus-cni-dir\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542053 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b0c5290-3824-46de-b9b4-2afec243d037-cni-binary-copy\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542085 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-multus-conf-dir\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542118 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-dbus\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542150 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-host\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542175 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-run-multus-certs\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542202 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6139918-9a98-4858-a206-ba8972b3a041-iptables-alerter-script\") pod \"iptables-alerter-wg5g5\" (UID: \"d6139918-9a98-4858-a206-ba8972b3a041\") " pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542225 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdhpg\" (UniqueName: \"kubernetes.io/projected/d6139918-9a98-4858-a206-ba8972b3a041-kube-api-access-xdhpg\") pod \"iptables-alerter-wg5g5\" (UID: \"d6139918-9a98-4858-a206-ba8972b3a041\") " pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542249 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71176e9a-093c-45ea-ac85-dbeb77c94b9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542295 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71176e9a-093c-45ea-ac85-dbeb77c94b9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:21.542364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542323 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-run\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.543015 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542364 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-cnibin\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.543015 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542413 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-var-lib-cni-bin\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.543015 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542445 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-hostroot\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.543015 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542467 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-etc-kubernetes\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.543015 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542481 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71cba711-068b-41aa-a58c-69836410353e-hosts-file\") pod \"node-resolver-ntmhl\" (UID: \"71cba711-068b-41aa-a58c-69836410353e\") " pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:21.543015 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.542503 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71176e9a-093c-45ea-ac85-dbeb77c94b9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:21.543521 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.543498 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.543556 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-sysctl-d\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.543956 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-systemd\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.543994 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a67fa71-e752-431c-8715-dc03dfdd68bb-tmp\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544022 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5nrf\" (UniqueName: \"kubernetes.io/projected/6a67fa71-e752-431c-8715-dc03dfdd68bb-kube-api-access-f5nrf\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544053 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-run-k8s-cni-cncf-io\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544085 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnc7z\" (UniqueName: \"kubernetes.io/projected/8b0c5290-3824-46de-b9b4-2afec243d037-kube-api-access-cnc7z\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544121 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-run-netns\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544151 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b0c5290-3824-46de-b9b4-2afec243d037-multus-daemon-config\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544177 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfq8x\" (UniqueName: \"kubernetes.io/projected/71cba711-068b-41aa-a58c-69836410353e-kube-api-access-hfq8x\") pod \"node-resolver-ntmhl\" (UID: \"71cba711-068b-41aa-a58c-69836410353e\") " pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544210 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f9sm\" (UniqueName: \"kubernetes.io/projected/71176e9a-093c-45ea-ac85-dbeb77c94b9f-kube-api-access-8f9sm\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544252 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-var-lib-kubelet\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544514 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-tuned\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544554 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-os-release\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544623 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-multus-socket-dir-parent\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.544670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544672 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71cba711-068b-41aa-a58c-69836410353e-tmp-dir\") pod \"node-resolver-ntmhl\" (UID: \"71cba711-068b-41aa-a58c-69836410353e\") " pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:21.545407 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544702 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-os-release\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:21.545407 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544735 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:21.545407 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544808 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-sys\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:21.545407 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544856 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-system-cni-dir\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.545407 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544896 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-var-lib-kubelet\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:21.545407 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.544941 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-kubelet-config\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:21.565111 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:21.565057 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7tg24" Jul 01 19:18:23.225111 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.225071 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7tg24" Jul 01 19:18:23.253275 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.253153 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal" event={"ID":"2884d80ef841c6fbcfc2434aecfb3b35","Type":"ContainerStarted","Data":"ed06c572ea020a1d90a0113a029c357bfe11ea4bf4d9ac1eca8649565269ce62"} Jul 01 19:18:23.254418 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.254393 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" event={"ID":"b6f9277c0ee99ce2a328a582777cf411","Type":"ContainerStarted","Data":"b0060a83d34c324d4abeb03734bcee7a63b4a2588b0ebc3b06979989650996bf"} Jul 01 19:18:23.283937 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.283905 2551 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:18:23.298068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298032 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-run\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.298292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298081 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506-host\") pod \"node-ca-s4knf\" (UID: \"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506\") " pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.298292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298109 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-sysctl-d\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.298292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298134 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-systemd\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.298292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298179 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5nrf\" (UniqueName: \"kubernetes.io/projected/6a67fa71-e752-431c-8715-dc03dfdd68bb-kube-api-access-f5nrf\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.298292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298205 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnc7z\" (UniqueName: \"kubernetes.io/projected/8b0c5290-3824-46de-b9b4-2afec243d037-kube-api-access-cnc7z\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.298292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298229 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82b42114-21a3-4ff8-87c3-ee5ba49f759f-konnectivity-ca\") pod \"konnectivity-agent-hc87r\" (UID: \"82b42114-21a3-4ff8-87c3-ee5ba49f759f\") " pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:23.298292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298254 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-run-systemd\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.298292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298265 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-run\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.298292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298285 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-sysctl-d\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298276 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-run-openvswitch\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298329 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-systemd\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298345 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b0c5290-3824-46de-b9b4-2afec243d037-multus-daemon-config\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298375 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfq8x\" (UniqueName: \"kubernetes.io/projected/71cba711-068b-41aa-a58c-69836410353e-kube-api-access-hfq8x\") pod \"node-resolver-ntmhl\" (UID: \"71cba711-068b-41aa-a58c-69836410353e\") " pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298406 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-registration-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298432 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-os-release\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298460 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298485 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298549 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-slash\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298601 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-sys\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298627 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-etc-selinux\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298654 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298718 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82b42114-21a3-4ff8-87c3-ee5ba49f759f-agent-certs\") pod \"konnectivity-agent-hc87r\" (UID: \"82b42114-21a3-4ff8-87c3-ee5ba49f759f\") " pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298754 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:23.298803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298794 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-modprobe-d\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298820 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-lib-modules\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298831 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298844 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-node-log\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298877 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-sys\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298917 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71176e9a-093c-45ea-ac85-dbeb77c94b9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298947 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71176e9a-093c-45ea-ac85-dbeb77c94b9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298976 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-sysctl-conf\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298991 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b0c5290-3824-46de-b9b4-2afec243d037-multus-daemon-config\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.298998 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-os-release\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299094 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b0c5290-3824-46de-b9b4-2afec243d037-cni-binary-copy\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299115 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-sys-fs\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299129 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-kubelet\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299150 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-log-socket\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299173 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-cni-bin\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299209 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-host\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299233 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-lib-modules\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.299528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299301 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-run-multus-certs\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299309 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-modprobe-d\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299332 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6139918-9a98-4858-a206-ba8972b3a041-iptables-alerter-script\") pod \"iptables-alerter-wg5g5\" (UID: \"d6139918-9a98-4858-a206-ba8972b3a041\") " pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299343 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-host\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299363 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f988757f-dbbd-417a-9e29-f3d482efb3de-ovnkube-script-lib\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299391 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-cnibin\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299416 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-var-lib-cni-bin\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299464 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71176e9a-093c-45ea-ac85-dbeb77c94b9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299484 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-cnibin\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299494 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-run-multus-certs\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299492 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-var-lib-cni-bin\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299508 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-hostroot\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299542 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-sysctl-conf\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299578 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-etc-kubernetes\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299612 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71cba711-068b-41aa-a58c-69836410353e-hosts-file\") pod \"node-resolver-ntmhl\" (UID: \"71cba711-068b-41aa-a58c-69836410353e\") " pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299587 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-hostroot\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299621 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-etc-kubernetes\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299667 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71176e9a-093c-45ea-ac85-dbeb77c94b9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.300364 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299720 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71cba711-068b-41aa-a58c-69836410353e-hosts-file\") pod \"node-resolver-ntmhl\" (UID: \"71cba711-068b-41aa-a58c-69836410353e\") " pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299758 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299793 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b0c5290-3824-46de-b9b4-2afec243d037-cni-binary-copy\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299818 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a67fa71-e752-431c-8715-dc03dfdd68bb-tmp\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299845 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-run-k8s-cni-cncf-io\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299867 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g52p7\" (UniqueName: \"kubernetes.io/projected/5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506-kube-api-access-g52p7\") pod \"node-ca-s4knf\" (UID: \"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506\") " pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299894 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-run-k8s-cni-cncf-io\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299895 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-run-netns\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299933 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f9sm\" (UniqueName: \"kubernetes.io/projected/71176e9a-093c-45ea-ac85-dbeb77c94b9f-kube-api-access-8f9sm\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299941 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-run-netns\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299962 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-var-lib-openvswitch\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299986 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-var-lib-kubelet\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.299996 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71176e9a-093c-45ea-ac85-dbeb77c94b9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300008 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-tuned\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300037 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-os-release\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300077 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6139918-9a98-4858-a206-ba8972b3a041-iptables-alerter-script\") pod \"iptables-alerter-wg5g5\" (UID: \"d6139918-9a98-4858-a206-ba8972b3a041\") " pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300110 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300111 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-multus-socket-dir-parent\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300174 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71cba711-068b-41aa-a58c-69836410353e-tmp-dir\") pod \"node-resolver-ntmhl\" (UID: \"71cba711-068b-41aa-a58c-69836410353e\") " pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300199 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-os-release\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300202 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300216 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71176e9a-093c-45ea-ac85-dbeb77c94b9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300244 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-device-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300270 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-systemd-units\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300297 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-system-cni-dir\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300307 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-var-lib-kubelet\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300323 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-var-lib-kubelet\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300269 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-multus-socket-dir-parent\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300352 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-kubelet-config\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300370 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-var-lib-kubelet\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300382 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-run-ovn\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300408 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-cni-netd\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300412 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-system-cni-dir\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300438 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f988757f-dbbd-417a-9e29-f3d482efb3de-ovnkube-config\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300463 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-kubelet-config\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:23.301933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300466 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f988757f-dbbd-417a-9e29-f3d482efb3de-env-overrides\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300481 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71cba711-068b-41aa-a58c-69836410353e-tmp-dir\") pod \"node-resolver-ntmhl\" (UID: \"71cba711-068b-41aa-a58c-69836410353e\") " pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300505 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f988757f-dbbd-417a-9e29-f3d482efb3de-ovn-node-metrics-cert\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300532 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtpp9\" (UniqueName: \"kubernetes.io/projected/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-kube-api-access-qtpp9\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300559 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-var-lib-cni-multus\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300583 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-kubernetes\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300616 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-host-var-lib-cni-multus\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300608 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300666 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-kubernetes\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300679 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6139918-9a98-4858-a206-ba8972b3a041-host-slash\") pod \"iptables-alerter-wg5g5\" (UID: \"d6139918-9a98-4858-a206-ba8972b3a041\") " pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.300716 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300723 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-system-cni-dir\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300727 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6139918-9a98-4858-a206-ba8972b3a041-host-slash\") pod \"iptables-alerter-wg5g5\" (UID: \"d6139918-9a98-4858-a206-ba8972b3a041\") " pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300750 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-cnibin\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300780 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-system-cni-dir\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.300797 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret podName:ee155ec6-3ff7-4afe-a20d-f7ea9289fe00 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:23.800766689 +0000 UTC m=+2.981098257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret") pod "global-pull-secret-syncer-rcmnr" (UID: "ee155ec6-3ff7-4afe-a20d-f7ea9289fe00") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300797 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71176e9a-093c-45ea-ac85-dbeb77c94b9f-cnibin\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.302738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300819 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-socket-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300850 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdhpg\" (UniqueName: \"kubernetes.io/projected/d6139918-9a98-4858-a206-ba8972b3a041-kube-api-access-xdhpg\") pod \"iptables-alerter-wg5g5\" (UID: \"d6139918-9a98-4858-a206-ba8972b3a041\") " pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300876 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-sysconfig\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300899 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-multus-cni-dir\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300921 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-multus-conf-dir\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300941 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-dbus\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300961 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-run-netns\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300973 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-sysconfig\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.300981 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506-serviceca\") pod \"node-ca-s4knf\" (UID: \"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506\") " pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.301026 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvt47\" (UniqueName: \"kubernetes.io/projected/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-kube-api-access-gvt47\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.301051 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-etc-openvswitch\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.301075 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpgc4\" (UniqueName: \"kubernetes.io/projected/f988757f-dbbd-417a-9e29-f3d482efb3de-kube-api-access-bpgc4\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.301090 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-multus-cni-dir\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.301121 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-dbus\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:23.303554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.301162 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b0c5290-3824-46de-b9b4-2afec243d037-multus-conf-dir\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.304245 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.304218 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a67fa71-e752-431c-8715-dc03dfdd68bb-tmp\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.305283 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.305233 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a67fa71-e752-431c-8715-dc03dfdd68bb-etc-tuned\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.309875 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.309836 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnc7z\" (UniqueName: \"kubernetes.io/projected/8b0c5290-3824-46de-b9b4-2afec243d037-kube-api-access-cnc7z\") pod \"multus-7kckl\" (UID: \"8b0c5290-3824-46de-b9b4-2afec243d037\") " pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.316716 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.316657 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f9sm\" (UniqueName: \"kubernetes.io/projected/71176e9a-093c-45ea-ac85-dbeb77c94b9f-kube-api-access-8f9sm\") pod \"multus-additional-cni-plugins-97zfk\" (UID: \"71176e9a-093c-45ea-ac85-dbeb77c94b9f\") " pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.320586 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.320559 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:23.320586 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.320589 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:23.320813 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.320603 2551 projected.go:196] Error preparing data for projected volume kube-api-access-kzwth for pod openshift-network-diagnostics/network-check-target-rbkmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:23.320813 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.320678 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth podName:1249ef53-37ad-47ac-bcc3-7377fdd3216c nodeName:}" failed. No retries permitted until 2026-07-01 19:18:23.820658828 +0000 UTC m=+3.000990385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kzwth" (UniqueName: "kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth") pod "network-check-target-rbkmp" (UID: "1249ef53-37ad-47ac-bcc3-7377fdd3216c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:23.322796 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.322742 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5nrf\" (UniqueName: \"kubernetes.io/projected/6a67fa71-e752-431c-8715-dc03dfdd68bb-kube-api-access-f5nrf\") pod \"tuned-fr8hq\" (UID: \"6a67fa71-e752-431c-8715-dc03dfdd68bb\") " pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.324365 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.324332 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdhpg\" (UniqueName: \"kubernetes.io/projected/d6139918-9a98-4858-a206-ba8972b3a041-kube-api-access-xdhpg\") pod \"iptables-alerter-wg5g5\" (UID: \"d6139918-9a98-4858-a206-ba8972b3a041\") " pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:23.325154 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.325110 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfq8x\" (UniqueName: \"kubernetes.io/projected/71cba711-068b-41aa-a58c-69836410353e-kube-api-access-hfq8x\") pod \"node-resolver-ntmhl\" (UID: \"71cba711-068b-41aa-a58c-69836410353e\") " pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:23.401532 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401491 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-sys-fs\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.401713 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401545 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-kubelet\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.401713 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401570 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-log-socket\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.401713 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401597 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-cni-bin\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.401713 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401623 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f988757f-dbbd-417a-9e29-f3d482efb3de-ovnkube-script-lib\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.401713 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401631 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-sys-fs\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.401713 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401653 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.401713 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401681 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g52p7\" (UniqueName: \"kubernetes.io/projected/5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506-kube-api-access-g52p7\") pod \"node-ca-s4knf\" (UID: \"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506\") " pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.401713 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401711 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-cni-bin\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401727 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-var-lib-openvswitch\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401752 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-kubelet\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401758 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401764 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401782 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-device-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401807 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-systemd-units\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401826 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-var-lib-openvswitch\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401833 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-run-ovn\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401855 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-cni-netd\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401879 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f988757f-dbbd-417a-9e29-f3d482efb3de-ovnkube-config\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401909 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f988757f-dbbd-417a-9e29-f3d482efb3de-env-overrides\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401934 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f988757f-dbbd-417a-9e29-f3d482efb3de-ovn-node-metrics-cert\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401958 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtpp9\" (UniqueName: \"kubernetes.io/projected/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-kube-api-access-qtpp9\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402001 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-socket-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402032 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-run-netns\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402055 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506-serviceca\") pod \"node-ca-s4knf\" (UID: \"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506\") " pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.402141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402088 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvt47\" (UniqueName: \"kubernetes.io/projected/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-kube-api-access-gvt47\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402103 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-cni-netd\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402110 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-etc-openvswitch\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.401725 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-log-socket\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402143 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpgc4\" (UniqueName: \"kubernetes.io/projected/f988757f-dbbd-417a-9e29-f3d482efb3de-kube-api-access-bpgc4\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402170 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506-host\") pod \"node-ca-s4knf\" (UID: \"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506\") " pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402199 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82b42114-21a3-4ff8-87c3-ee5ba49f759f-konnectivity-ca\") pod \"konnectivity-agent-hc87r\" (UID: \"82b42114-21a3-4ff8-87c3-ee5ba49f759f\") " pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402177 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402256 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-device-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402300 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-systemd-units\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402350 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-run-ovn\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402347 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f988757f-dbbd-417a-9e29-f3d482efb3de-ovnkube-script-lib\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402376 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-run-systemd\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402407 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-run-openvswitch\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402435 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-registration-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402462 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402485 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-slash\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403016 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402509 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-etc-selinux\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402534 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402560 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82b42114-21a3-4ff8-87c3-ee5ba49f759f-agent-certs\") pod \"konnectivity-agent-hc87r\" (UID: \"82b42114-21a3-4ff8-87c3-ee5ba49f759f\") " pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402599 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-node-log\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402608 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f988757f-dbbd-417a-9e29-f3d482efb3de-ovnkube-config\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402667 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-node-log\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402668 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-socket-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402722 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-run-netns\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402732 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-run-systemd\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402769 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-run-openvswitch\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402789 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82b42114-21a3-4ff8-87c3-ee5ba49f759f-konnectivity-ca\") pod \"konnectivity-agent-hc87r\" (UID: \"82b42114-21a3-4ff8-87c3-ee5ba49f759f\") " pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.402814 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-registration-dir\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.402889 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.402945 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs podName:7f2bd16e-ec4a-4b9f-a85e-702aa920d41b nodeName:}" failed. No retries permitted until 2026-07-01 19:18:23.902928961 +0000 UTC m=+3.083260504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs") pod "network-metrics-daemon-dp5wv" (UID: "7f2bd16e-ec4a-4b9f-a85e-702aa920d41b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.403078 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-etc-openvswitch\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.403110 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506-serviceca\") pod \"node-ca-s4knf\" (UID: \"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506\") " pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.403132 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.403718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.403172 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f988757f-dbbd-417a-9e29-f3d482efb3de-env-overrides\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.404513 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.403181 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f988757f-dbbd-417a-9e29-f3d482efb3de-host-slash\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.404513 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.403241 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506-host\") pod \"node-ca-s4knf\" (UID: \"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506\") " pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.404513 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.403253 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-etc-selinux\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.407096 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.407038 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82b42114-21a3-4ff8-87c3-ee5ba49f759f-agent-certs\") pod \"konnectivity-agent-hc87r\" (UID: \"82b42114-21a3-4ff8-87c3-ee5ba49f759f\") " pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:23.407717 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.407667 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f988757f-dbbd-417a-9e29-f3d482efb3de-ovn-node-metrics-cert\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.415623 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.415599 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g52p7\" (UniqueName: \"kubernetes.io/projected/5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506-kube-api-access-g52p7\") pod \"node-ca-s4knf\" (UID: \"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506\") " pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.419033 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.418951 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvt47\" (UniqueName: \"kubernetes.io/projected/932cc1ec-3373-4df2-a4a8-ef469aeca0d3-kube-api-access-gvt47\") pod \"aws-ebs-csi-driver-node-w9x9w\" (UID: \"932cc1ec-3373-4df2-a4a8-ef469aeca0d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.419584 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.419537 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpgc4\" (UniqueName: \"kubernetes.io/projected/f988757f-dbbd-417a-9e29-f3d482efb3de-kube-api-access-bpgc4\") pod \"ovnkube-node-ggrjp\" (UID: \"f988757f-dbbd-417a-9e29-f3d482efb3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.419734 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.419712 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtpp9\" (UniqueName: \"kubernetes.io/projected/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-kube-api-access-qtpp9\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:23.491038 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.491001 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wg5g5" Jul 01 19:18:23.500244 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.500217 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ntmhl" Jul 01 19:18:23.508395 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.508368 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" Jul 01 19:18:23.513188 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.513165 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7kckl" Jul 01 19:18:23.520213 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.520188 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-97zfk" Jul 01 19:18:23.528414 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.528244 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" Jul 01 19:18:23.534263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.534236 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:23.539608 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.539582 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:23.544617 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.544593 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s4knf" Jul 01 19:18:23.669549 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:23.669468 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0c5290_3824_46de_b9b4_2afec243d037.slice/crio-91350fa01d4c87e54e4dbfbf78567c30c641502f7f4fe614599288130f2210bc WatchSource:0}: Error finding container 91350fa01d4c87e54e4dbfbf78567c30c641502f7f4fe614599288130f2210bc: Status 404 returned error can't find the container with id 91350fa01d4c87e54e4dbfbf78567c30c641502f7f4fe614599288130f2210bc Jul 01 19:18:23.673569 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:23.673303 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6139918_9a98_4858_a206_ba8972b3a041.slice/crio-1599c087369f31dd7ef211a37244498ba1a8f325e2718e3d04d96d4c2ad7cfe5 WatchSource:0}: Error finding container 1599c087369f31dd7ef211a37244498ba1a8f325e2718e3d04d96d4c2ad7cfe5: Status 404 returned error can't find the container with id 1599c087369f31dd7ef211a37244498ba1a8f325e2718e3d04d96d4c2ad7cfe5 Jul 01 19:18:23.673569 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.673447 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:18:23.675074 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:23.674939 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf988757f_dbbd_417a_9e29_f3d482efb3de.slice/crio-6bffd509402544bf022a24a6325f81fe94d5f405bb063652eca9a7adc8945c5d WatchSource:0}: Error finding container 6bffd509402544bf022a24a6325f81fe94d5f405bb063652eca9a7adc8945c5d: Status 404 returned error can't find the container with id 6bffd509402544bf022a24a6325f81fe94d5f405bb063652eca9a7adc8945c5d Jul 01 19:18:23.676895 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:23.676510 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71cba711_068b_41aa_a58c_69836410353e.slice/crio-63ac296950a94fe40e4c9252ad1890304e2e24221cde58abd48f56ecb38187c7 WatchSource:0}: Error finding container 63ac296950a94fe40e4c9252ad1890304e2e24221cde58abd48f56ecb38187c7: Status 404 returned error can't find the container with id 63ac296950a94fe40e4c9252ad1890304e2e24221cde58abd48f56ecb38187c7 Jul 01 19:18:23.679877 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:23.679852 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a67fa71_e752_431c_8715_dc03dfdd68bb.slice/crio-add4e6076dff4bfd44ad10e922bec19b996573fcb9ebf93ba39ef41028792718 WatchSource:0}: Error finding container add4e6076dff4bfd44ad10e922bec19b996573fcb9ebf93ba39ef41028792718: Status 404 returned error can't find the container with id add4e6076dff4bfd44ad10e922bec19b996573fcb9ebf93ba39ef41028792718 Jul 01 19:18:23.681306 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:23.681281 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc3f1dd_96e3_42de_bb5d_6bef5d6fa506.slice/crio-3f2bee92f04b8bb2b11dfc4460c179da8ef4537ee8d1b960fb00c608bb0e3bac WatchSource:0}: Error finding container 3f2bee92f04b8bb2b11dfc4460c179da8ef4537ee8d1b960fb00c608bb0e3bac: Status 404 returned error can't find the container with id 3f2bee92f04b8bb2b11dfc4460c179da8ef4537ee8d1b960fb00c608bb0e3bac Jul 01 19:18:23.681996 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:23.681959 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b42114_21a3_4ff8_87c3_ee5ba49f759f.slice/crio-729af2996535020600fc2f252a940dfb0331d249c9cc9eade0f03a2092cb22e6 WatchSource:0}: Error finding container 729af2996535020600fc2f252a940dfb0331d249c9cc9eade0f03a2092cb22e6: Status 404 returned error can't find the container with id 729af2996535020600fc2f252a940dfb0331d249c9cc9eade0f03a2092cb22e6 Jul 01 19:18:23.683224 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:23.683160 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932cc1ec_3373_4df2_a4a8_ef469aeca0d3.slice/crio-3751f0002a81d323ca4373141f80b369f2df10db1887d3214b587ff0674e13b4 WatchSource:0}: Error finding container 3751f0002a81d323ca4373141f80b369f2df10db1887d3214b587ff0674e13b4: Status 404 returned error can't find the container with id 3751f0002a81d323ca4373141f80b369f2df10db1887d3214b587ff0674e13b4 Jul 01 19:18:23.683672 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:23.683638 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71176e9a_093c_45ea_ac85_dbeb77c94b9f.slice/crio-7da03665c8589f54a4c37afe4a4148bef82f606259acb6c7819f483306f94012 WatchSource:0}: Error finding container 7da03665c8589f54a4c37afe4a4148bef82f606259acb6c7819f483306f94012: Status 404 returned error can't find the container with id 7da03665c8589f54a4c37afe4a4148bef82f606259acb6c7819f483306f94012 Jul 01 19:18:23.805653 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.805615 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:23.805837 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.805794 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:23.805890 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.805866 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret podName:ee155ec6-3ff7-4afe-a20d-f7ea9289fe00 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:24.805848283 +0000 UTC m=+3.986179831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret") pod "global-pull-secret-syncer-rcmnr" (UID: "ee155ec6-3ff7-4afe-a20d-f7ea9289fe00") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:23.906005 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.905974 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:23.906159 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:23.906014 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:23.906159 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.906141 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:23.906231 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.906215 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs podName:7f2bd16e-ec4a-4b9f-a85e-702aa920d41b nodeName:}" failed. No retries permitted until 2026-07-01 19:18:24.906195834 +0000 UTC m=+4.086527396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs") pod "network-metrics-daemon-dp5wv" (UID: "7f2bd16e-ec4a-4b9f-a85e-702aa920d41b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:23.906271 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.906142 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:23.906271 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.906252 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:23.906271 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.906264 2551 projected.go:196] Error preparing data for projected volume kube-api-access-kzwth for pod openshift-network-diagnostics/network-check-target-rbkmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:23.906397 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:23.906313 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth podName:1249ef53-37ad-47ac-bcc3-7377fdd3216c nodeName:}" failed. No retries permitted until 2026-07-01 19:18:24.906300699 +0000 UTC m=+4.086632245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzwth" (UniqueName: "kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth") pod "network-check-target-rbkmp" (UID: "1249ef53-37ad-47ac-bcc3-7377fdd3216c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:24.227923 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.227764 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:13:23 +0000 UTC" deadline="2028-02-07 11:22:48.706679706 +0000 UTC" Jul 01 19:18:24.227923 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.227821 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14056h4m24.478863597s" Jul 01 19:18:24.259926 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.259789 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wg5g5" event={"ID":"d6139918-9a98-4858-a206-ba8972b3a041","Type":"ContainerStarted","Data":"1599c087369f31dd7ef211a37244498ba1a8f325e2718e3d04d96d4c2ad7cfe5"} Jul 01 19:18:24.261635 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.261604 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7kckl" event={"ID":"8b0c5290-3824-46de-b9b4-2afec243d037","Type":"ContainerStarted","Data":"91350fa01d4c87e54e4dbfbf78567c30c641502f7f4fe614599288130f2210bc"} Jul 01 19:18:24.265183 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.265151 2551 generic.go:356] "Generic (PLEG): container finished" podID="b6f9277c0ee99ce2a328a582777cf411" containerID="7e92aeb35734b2903418d0662560d38eb6798876d0b0033c842a2568fa5445c5" exitCode=0 Jul 01 19:18:24.265321 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.265235 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" event={"ID":"b6f9277c0ee99ce2a328a582777cf411","Type":"ContainerDied","Data":"7e92aeb35734b2903418d0662560d38eb6798876d0b0033c842a2568fa5445c5"} Jul 01 19:18:24.276115 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.275789 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" event={"ID":"932cc1ec-3373-4df2-a4a8-ef469aeca0d3","Type":"ContainerStarted","Data":"3751f0002a81d323ca4373141f80b369f2df10db1887d3214b587ff0674e13b4"} Jul 01 19:18:24.279362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.279287 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97zfk" event={"ID":"71176e9a-093c-45ea-ac85-dbeb77c94b9f","Type":"ContainerStarted","Data":"7da03665c8589f54a4c37afe4a4148bef82f606259acb6c7819f483306f94012"} Jul 01 19:18:24.282217 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.282140 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hc87r" event={"ID":"82b42114-21a3-4ff8-87c3-ee5ba49f759f","Type":"ContainerStarted","Data":"729af2996535020600fc2f252a940dfb0331d249c9cc9eade0f03a2092cb22e6"} Jul 01 19:18:24.283785 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.283755 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s4knf" event={"ID":"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506","Type":"ContainerStarted","Data":"3f2bee92f04b8bb2b11dfc4460c179da8ef4537ee8d1b960fb00c608bb0e3bac"} Jul 01 19:18:24.286319 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.286296 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" event={"ID":"6a67fa71-e752-431c-8715-dc03dfdd68bb","Type":"ContainerStarted","Data":"add4e6076dff4bfd44ad10e922bec19b996573fcb9ebf93ba39ef41028792718"} Jul 01 19:18:24.287946 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.287925 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ntmhl" event={"ID":"71cba711-068b-41aa-a58c-69836410353e","Type":"ContainerStarted","Data":"63ac296950a94fe40e4c9252ad1890304e2e24221cde58abd48f56ecb38187c7"} Jul 01 19:18:24.289762 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.289664 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerStarted","Data":"6bffd509402544bf022a24a6325f81fe94d5f405bb063652eca9a7adc8945c5d"} Jul 01 19:18:24.815810 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.815234 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:24.815810 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:24.815411 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:24.815810 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:24.815470 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret podName:ee155ec6-3ff7-4afe-a20d-f7ea9289fe00 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:26.815451867 +0000 UTC m=+5.995783413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret") pod "global-pull-secret-syncer-rcmnr" (UID: "ee155ec6-3ff7-4afe-a20d-f7ea9289fe00") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:24.916759 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.916617 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:24.916759 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:24.916673 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:24.917021 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:24.916898 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:24.917021 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:24.916922 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:24.917021 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:24.916935 2551 projected.go:196] Error preparing data for projected volume kube-api-access-kzwth for pod openshift-network-diagnostics/network-check-target-rbkmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:24.917021 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:24.916996 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth podName:1249ef53-37ad-47ac-bcc3-7377fdd3216c nodeName:}" failed. No retries permitted until 2026-07-01 19:18:26.916977386 +0000 UTC m=+6.097308934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzwth" (UniqueName: "kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth") pod "network-check-target-rbkmp" (UID: "1249ef53-37ad-47ac-bcc3-7377fdd3216c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:24.917435 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:24.917409 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:24.917510 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:24.917467 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs podName:7f2bd16e-ec4a-4b9f-a85e-702aa920d41b nodeName:}" failed. No retries permitted until 2026-07-01 19:18:26.917450448 +0000 UTC m=+6.097781993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs") pod "network-metrics-daemon-dp5wv" (UID: "7f2bd16e-ec4a-4b9f-a85e-702aa920d41b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:25.228962 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:25.228799 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:13:23 +0000 UTC" deadline="2028-04-17 05:10:15.841622154 +0000 UTC" Jul 01 19:18:25.228962 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:25.228910 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15729h51m50.612716857s" Jul 01 19:18:25.250837 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:25.250798 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:25.251013 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:25.250807 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:25.251013 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:25.250938 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:25.251136 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:25.251032 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:25.251136 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:25.251097 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:25.251232 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:25.251162 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:25.306160 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:25.306120 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" event={"ID":"b6f9277c0ee99ce2a328a582777cf411","Type":"ContainerStarted","Data":"3a262323efc59624e5ef91590bca36f9285166e68ff779b8592b13c6c9b49343"} Jul 01 19:18:25.314457 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:25.314423 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal" event={"ID":"2884d80ef841c6fbcfc2434aecfb3b35","Type":"ContainerStarted","Data":"a2df9dc17389f59a32141d479082f1dbdecf98e5387a186781a70c427b48c86d"} Jul 01 19:18:25.323593 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:25.322620 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-127.ec2.internal" podStartSLOduration=3.322599488 podStartE2EDuration="3.322599488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:25.322525919 +0000 UTC m=+4.502857505" watchObservedRunningTime="2026-07-01 19:18:25.322599488 +0000 UTC m=+4.502931053" Jul 01 19:18:25.338807 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:25.338427 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-127.ec2.internal" podStartSLOduration=3.338401295 podStartE2EDuration="3.338401295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:25.337672301 +0000 UTC m=+4.518003866" watchObservedRunningTime="2026-07-01 19:18:25.338401295 +0000 UTC m=+4.518732860" Jul 01 19:18:26.832378 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:26.831701 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:26.832378 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:26.831900 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:26.832378 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:26.831966 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret podName:ee155ec6-3ff7-4afe-a20d-f7ea9289fe00 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:30.831945555 +0000 UTC m=+10.012277103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret") pod "global-pull-secret-syncer-rcmnr" (UID: "ee155ec6-3ff7-4afe-a20d-f7ea9289fe00") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:26.932959 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:26.932922 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:26.933133 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:26.932974 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:26.933133 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:26.933117 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:26.933237 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:26.933136 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:26.933237 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:26.933148 2551 projected.go:196] Error preparing data for projected volume kube-api-access-kzwth for pod openshift-network-diagnostics/network-check-target-rbkmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:26.933237 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:26.933205 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth podName:1249ef53-37ad-47ac-bcc3-7377fdd3216c nodeName:}" failed. No retries permitted until 2026-07-01 19:18:30.93318696 +0000 UTC m=+10.113518522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzwth" (UniqueName: "kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth") pod "network-check-target-rbkmp" (UID: "1249ef53-37ad-47ac-bcc3-7377fdd3216c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:26.933658 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:26.933627 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:26.933791 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:26.933711 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs podName:7f2bd16e-ec4a-4b9f-a85e-702aa920d41b nodeName:}" failed. No retries permitted until 2026-07-01 19:18:30.933681341 +0000 UTC m=+10.114012904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs") pod "network-metrics-daemon-dp5wv" (UID: "7f2bd16e-ec4a-4b9f-a85e-702aa920d41b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:27.250656 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:27.250215 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:27.250656 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:27.250313 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:27.250656 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:27.250602 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:27.250974 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:27.250721 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:27.250974 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:27.250786 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:27.250974 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:27.250904 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:29.250039 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:29.249540 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:29.250039 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:29.249541 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:29.250039 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:29.249679 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:29.250039 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:29.249828 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:29.250039 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:29.249882 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:29.250039 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:29.249937 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:30.869029 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:30.868977 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:30.869500 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:30.869133 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:30.869500 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:30.869193 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret podName:ee155ec6-3ff7-4afe-a20d-f7ea9289fe00 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:38.869174342 +0000 UTC m=+18.049505889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret") pod "global-pull-secret-syncer-rcmnr" (UID: "ee155ec6-3ff7-4afe-a20d-f7ea9289fe00") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:30.969928 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:30.969884 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:30.970096 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:30.969948 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:30.970172 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:30.970147 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:30.970172 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:30.970165 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:30.970279 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:30.970174 2551 projected.go:196] Error preparing data for projected volume kube-api-access-kzwth for pod openshift-network-diagnostics/network-check-target-rbkmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:30.970279 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:30.970224 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth podName:1249ef53-37ad-47ac-bcc3-7377fdd3216c nodeName:}" failed. No retries permitted until 2026-07-01 19:18:38.970211263 +0000 UTC m=+18.150542807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzwth" (UniqueName: "kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth") pod "network-check-target-rbkmp" (UID: "1249ef53-37ad-47ac-bcc3-7377fdd3216c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:30.970599 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:30.970502 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:30.970599 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:30.970576 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs podName:7f2bd16e-ec4a-4b9f-a85e-702aa920d41b nodeName:}" failed. No retries permitted until 2026-07-01 19:18:38.970557623 +0000 UTC m=+18.150889186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs") pod "network-metrics-daemon-dp5wv" (UID: "7f2bd16e-ec4a-4b9f-a85e-702aa920d41b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:31.252852 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:31.252374 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:31.252852 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:31.252490 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:31.252852 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:31.252765 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:31.253103 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:31.252874 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:31.253103 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:31.252765 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:31.253103 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:31.252970 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:33.249718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:33.249641 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:33.250181 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:33.249764 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:33.250181 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:33.249641 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:33.250181 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:33.249788 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:33.250181 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:33.249936 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:33.250181 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:33.250024 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:35.250213 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:35.250176 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:35.250678 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:35.250176 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:35.250678 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:35.250306 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:35.250678 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:35.250179 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:35.250678 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:35.250384 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:35.250678 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:35.250503 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:37.250333 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:37.250260 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:37.250905 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:37.250276 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:37.250905 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:37.250399 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:37.250905 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:37.250277 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:37.250905 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:37.250500 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:37.250905 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:37.250566 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:38.931256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:38.931161 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:38.931771 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:38.931357 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:38.931771 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:38.931445 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret podName:ee155ec6-3ff7-4afe-a20d-f7ea9289fe00 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:54.931425315 +0000 UTC m=+34.111756864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret") pod "global-pull-secret-syncer-rcmnr" (UID: "ee155ec6-3ff7-4afe-a20d-f7ea9289fe00") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:39.031882 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:39.031843 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:39.031882 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:39.031889 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:39.032090 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:39.032005 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:39.032090 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:39.032020 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:39.032090 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:39.032018 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:39.032201 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:39.032098 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs podName:7f2bd16e-ec4a-4b9f-a85e-702aa920d41b nodeName:}" failed. No retries permitted until 2026-07-01 19:18:55.032078525 +0000 UTC m=+34.212410070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs") pod "network-metrics-daemon-dp5wv" (UID: "7f2bd16e-ec4a-4b9f-a85e-702aa920d41b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:39.032201 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:39.032031 2551 projected.go:196] Error preparing data for projected volume kube-api-access-kzwth for pod openshift-network-diagnostics/network-check-target-rbkmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:39.032201 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:39.032153 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth podName:1249ef53-37ad-47ac-bcc3-7377fdd3216c nodeName:}" failed. No retries permitted until 2026-07-01 19:18:55.032141685 +0000 UTC m=+34.212473227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzwth" (UniqueName: "kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth") pod "network-check-target-rbkmp" (UID: "1249ef53-37ad-47ac-bcc3-7377fdd3216c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:39.250330 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:39.250242 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:39.250493 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:39.250242 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:39.250493 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:39.250393 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:39.250493 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:39.250471 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:39.250649 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:39.250255 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:39.250649 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:39.250561 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:41.250233 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:41.250205 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:41.250657 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:41.250306 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:41.250657 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:41.250356 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:41.250657 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:41.250438 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:41.250657 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:41.250461 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:41.250657 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:41.250495 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:43.249816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.249639 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:43.250306 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.249643 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:43.250306 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:43.249897 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:43.250306 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.249710 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:43.250306 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:43.249994 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:43.250306 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:43.250016 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:43.353660 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.353623 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ntmhl" event={"ID":"71cba711-068b-41aa-a58c-69836410353e","Type":"ContainerStarted","Data":"2447d63f341064db3f00b2a7e8cd5867a91fee62b5dfcb5aa6a73d2b68cf2ec9"} Jul 01 19:18:43.356066 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.355992 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:18:43.356401 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.356376 2551 generic.go:356] "Generic (PLEG): container finished" podID="f988757f-dbbd-417a-9e29-f3d482efb3de" containerID="95c5e643052a407c77a6e4ac56d302834c4397abfbb760806f7fbabea70cbeb3" exitCode=1 Jul 01 19:18:43.356468 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.356449 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerStarted","Data":"b291950e889e8a282989170d4b10a0238202fc0a5058f0b78493ff7c9ac04d91"} Jul 01 19:18:43.356613 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.356515 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerStarted","Data":"3d04ff4cfc8a94a7d57b50754049d72ab7047ccdb146e88b8913ac38a0d8ce66"} Jul 01 19:18:43.356613 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.356553 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerStarted","Data":"09b8eaf4c5c0026c6180839bd00b06017f12086a8c4d1bc2f5225ad2e27e87f0"} Jul 01 19:18:43.356613 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.356591 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerDied","Data":"95c5e643052a407c77a6e4ac56d302834c4397abfbb760806f7fbabea70cbeb3"} Jul 01 19:18:43.356751 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.356636 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerStarted","Data":"8aee8680a3abc6e4e21d003b327be0d27ce0b3abad3bd72a44c0bb73e771af4d"} Jul 01 19:18:43.358076 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.358052 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7kckl" event={"ID":"8b0c5290-3824-46de-b9b4-2afec243d037","Type":"ContainerStarted","Data":"eb6fa04167eb19d7865c63c987917b0d854aec3acbc0c9d500432d3e17b98584"} Jul 01 19:18:43.359735 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.359713 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" event={"ID":"932cc1ec-3373-4df2-a4a8-ef469aeca0d3","Type":"ContainerStarted","Data":"bfa2e209734a42ad464248dae797d7a947ae1c08c1dab0bcdc9fb5994ea83e79"} Jul 01 19:18:43.361215 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.361192 2551 generic.go:356] "Generic (PLEG): container finished" podID="71176e9a-093c-45ea-ac85-dbeb77c94b9f" containerID="ec3d3d66dfcfa1f6e7c9e789bf27338eb085bf4eca531cdb0cfa3e446a235a5e" exitCode=0 Jul 01 19:18:43.361314 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.361274 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97zfk" event={"ID":"71176e9a-093c-45ea-ac85-dbeb77c94b9f","Type":"ContainerDied","Data":"ec3d3d66dfcfa1f6e7c9e789bf27338eb085bf4eca531cdb0cfa3e446a235a5e"} Jul 01 19:18:43.362818 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.362784 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hc87r" event={"ID":"82b42114-21a3-4ff8-87c3-ee5ba49f759f","Type":"ContainerStarted","Data":"56ae77d59e6f787cd3e0482008238b18d6c4c13bc821edd4f5012be62c5f5f63"} Jul 01 19:18:43.364275 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.364251 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s4knf" event={"ID":"5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506","Type":"ContainerStarted","Data":"a44a5cd3e4d629923c81a04e2446c8d4ce1be1b402d3cbac70106b166ee8c4b2"} Jul 01 19:18:43.365522 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.365502 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" event={"ID":"6a67fa71-e752-431c-8715-dc03dfdd68bb","Type":"ContainerStarted","Data":"04114ea010e624496d88bc611788241a6baa671ab45d4ce8f136aa4d6d90a3da"} Jul 01 19:18:43.370157 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.370121 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ntmhl" podStartSLOduration=3.406465143 podStartE2EDuration="22.370109922s" totalImagesPullingTime="18.963644779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:43.369549266 +0000 UTC m=+22.549880831" watchObservedRunningTime="2026-07-01 19:18:43.370109922 +0000 UTC m=+22.550441489" Jul 01 19:18:43.388797 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.388752 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fr8hq" podStartSLOduration=3.428618426 podStartE2EDuration="22.388736747s" totalImagesPullingTime="18.960118321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:43.388587949 +0000 UTC m=+22.568919513" watchObservedRunningTime="2026-07-01 19:18:43.388736747 +0000 UTC m=+22.569068310" Jul 01 19:18:43.408020 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.407964 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7kckl" podStartSLOduration=3.100624036 podStartE2EDuration="22.407948805s" totalImagesPullingTime="19.307324769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:43.407679936 +0000 UTC m=+22.588011501" watchObservedRunningTime="2026-07-01 19:18:43.407948805 +0000 UTC m=+22.588280368" Jul 01 19:18:43.454636 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.454583 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hc87r" podStartSLOduration=3.917443156 podStartE2EDuration="22.454567727s" totalImagesPullingTime="18.537124571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:43.454060608 +0000 UTC m=+22.634392171" watchObservedRunningTime="2026-07-01 19:18:43.454567727 +0000 UTC m=+22.634899290" Jul 01 19:18:43.469889 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.469846 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s4knf" podStartSLOduration=3.511106666 podStartE2EDuration="22.469831649s" totalImagesPullingTime="18.958724983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:43.469101725 +0000 UTC m=+22.649433289" watchObservedRunningTime="2026-07-01 19:18:43.469831649 +0000 UTC m=+22.650163213" Jul 01 19:18:43.555062 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.555021 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:43.619768 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.619736 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:43.630160 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.630130 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:43.717427 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:43.717397 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:44.370105 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:44.370078 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:18:44.370635 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:44.370476 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerStarted","Data":"2b6766fbfb4eb637b7df0091d1d2b7ddcb468bc975bf5db2f5b86287497f7565"} Jul 01 19:18:44.371901 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:44.371869 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wg5g5" event={"ID":"d6139918-9a98-4858-a206-ba8972b3a041","Type":"ContainerStarted","Data":"40c7152101118072836f6fac738a7d2e9ed666bd89520a6fcf9f76c149f48094"} Jul 01 19:18:44.387436 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:44.387366 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wg5g5" podStartSLOduration=4.418629363 podStartE2EDuration="23.387351126s" totalImagesPullingTime="18.968721763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:44.386805844 +0000 UTC m=+23.567137407" watchObservedRunningTime="2026-07-01 19:18:44.387351126 +0000 UTC m=+23.567682690" Jul 01 19:18:44.506501 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:44.506467 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:44.611197 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:44.611163 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:18:44.614562 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:44.614530 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:45.250040 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:45.250010 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:45.250338 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:45.250019 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:45.250338 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:45.250153 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:45.250338 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:45.250209 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:45.250338 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:45.250020 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:45.250338 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:45.250306 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:45.252149 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:45.252060 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:18:44.611192602Z","UUID":"8b86cdc3-2d8f-47f6-ae41-7dc1b56fe037","Handler":null,"Name":"","Endpoint":""} Jul 01 19:18:45.253842 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:45.253819 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:18:45.253948 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:45.253863 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:18:45.377059 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:45.377015 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" event={"ID":"932cc1ec-3373-4df2-a4a8-ef469aeca0d3","Type":"ContainerStarted","Data":"f51ce3a87ea93fdcd088d9d55b380b0c70f034fda11bfdf4c93a39e26f5fb1ec"} Jul 01 19:18:46.382285 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:46.382032 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" event={"ID":"932cc1ec-3373-4df2-a4a8-ef469aeca0d3","Type":"ContainerStarted","Data":"3ea146be697df44e5ce39fbf143a64fb6352cd6d49e84ef5d996aec01a215625"} Jul 01 19:18:46.386088 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:46.386061 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:18:46.386481 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:46.386455 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerStarted","Data":"94ba82e6cd4367fa9f1d094291bdcb9611c01037912762ea59455957793d619d"} Jul 01 19:18:46.399965 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:46.399908 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w9x9w" podStartSLOduration=3.539446469 podStartE2EDuration="25.399887552s" totalImagesPullingTime="21.860441083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:46.399566897 +0000 UTC m=+25.579898492" watchObservedRunningTime="2026-07-01 19:18:46.399887552 +0000 UTC m=+25.580219118" Jul 01 19:18:46.529653 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:46.529616 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:46.530273 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:46.530251 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:46.598965 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:46.598922 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:46.685226 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:46.685137 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:46.784643 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:46.784609 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:47.253570 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:47.253538 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:47.253570 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:47.253554 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:47.253836 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:47.253556 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:47.253836 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:47.253654 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:47.253836 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:47.253757 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:47.253979 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:47.253870 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:47.390119 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:47.390092 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hc87r" Jul 01 19:18:47.449569 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:47.449525 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:48.393622 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.393586 2551 generic.go:356] "Generic (PLEG): container finished" podID="71176e9a-093c-45ea-ac85-dbeb77c94b9f" containerID="7201616be582b6b7d13a6517c663acd64d7fd90ea8eb3311343cd447150e4b34" exitCode=0 Jul 01 19:18:48.394245 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.393664 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97zfk" event={"ID":"71176e9a-093c-45ea-ac85-dbeb77c94b9f","Type":"ContainerDied","Data":"7201616be582b6b7d13a6517c663acd64d7fd90ea8eb3311343cd447150e4b34"} Jul 01 19:18:48.397205 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.397186 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:18:48.397655 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.397627 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerStarted","Data":"996ca9156c42a0c1b601c892a5b89489177efccf7946fb25dabf630072b8465a"} Jul 01 19:18:48.398064 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.398009 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:48.398162 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.398084 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:48.398162 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.398088 2551 scope.go:117] "RemoveContainer" containerID="95c5e643052a407c77a6e4ac56d302834c4397abfbb760806f7fbabea70cbeb3" Jul 01 19:18:48.413974 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.413948 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:48.414505 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.414481 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:48.654557 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.654519 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:48.711677 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:48.711637 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:49.250199 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:49.250167 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:49.250417 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:49.250173 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:49.250417 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:49.250271 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:49.250510 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:49.250406 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:49.250510 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:49.250444 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:49.250593 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:49.250522 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:49.405412 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:49.405379 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:18:49.405867 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:49.405821 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" event={"ID":"f988757f-dbbd-417a-9e29-f3d482efb3de","Type":"ContainerStarted","Data":"ab4a0bec706696258bb4dfde1c3fb84762a09e070951482e84a02b5e65b04c13"} Jul 01 19:18:49.408896 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:49.408873 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:18:49.436936 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:49.436889 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" podStartSLOduration=9.452622677 podStartE2EDuration="28.436873527s" totalImagesPullingTime="18.98425085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:49.436225489 +0000 UTC m=+28.616557076" watchObservedRunningTime="2026-07-01 19:18:49.436873527 +0000 UTC m=+28.617205089" Jul 01 19:18:50.264833 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.264613 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rcmnr"] Jul 01 19:18:50.265012 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.264924 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:50.265084 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:50.265034 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:50.265270 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.265245 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dp5wv"] Jul 01 19:18:50.265380 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.265337 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:50.265448 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:50.265428 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:50.269335 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.269312 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbkmp"] Jul 01 19:18:50.269440 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.269384 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:50.269488 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:50.269445 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:50.410792 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.410757 2551 generic.go:356] "Generic (PLEG): container finished" podID="71176e9a-093c-45ea-ac85-dbeb77c94b9f" containerID="cb74c84e492630dde16da79fe836dbe2a6a60d69d08ba5d120cfdddef55d7fc1" exitCode=0 Jul 01 19:18:50.411143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.410837 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97zfk" event={"ID":"71176e9a-093c-45ea-ac85-dbeb77c94b9f","Type":"ContainerDied","Data":"cb74c84e492630dde16da79fe836dbe2a6a60d69d08ba5d120cfdddef55d7fc1"} Jul 01 19:18:50.760721 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.760664 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:50.824981 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.824948 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:50.884226 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:50.884186 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:52.249771 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:52.249734 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:52.249771 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:52.249761 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:52.250375 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:52.249735 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:52.250375 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:52.249843 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:52.250375 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:52.249917 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:52.250375 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:52.249996 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:52.418728 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:52.418557 2551 generic.go:356] "Generic (PLEG): container finished" podID="71176e9a-093c-45ea-ac85-dbeb77c94b9f" containerID="138832616afcc1526b233189b817ef25eaf9527f5850ced3bcd9e1c3044c9800" exitCode=0 Jul 01 19:18:52.418728 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:52.418609 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97zfk" event={"ID":"71176e9a-093c-45ea-ac85-dbeb77c94b9f","Type":"ContainerDied","Data":"138832616afcc1526b233189b817ef25eaf9527f5850ced3bcd9e1c3044c9800"} Jul 01 19:18:54.249408 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:54.249368 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:54.249954 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:54.249409 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:54.249954 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:54.249504 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkmp" podUID="1249ef53-37ad-47ac-bcc3-7377fdd3216c" Jul 01 19:18:54.249954 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:54.249570 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcmnr" podUID="ee155ec6-3ff7-4afe-a20d-f7ea9289fe00" Jul 01 19:18:54.249954 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:54.249589 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:54.249954 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:54.249710 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dp5wv" podUID="7f2bd16e-ec4a-4b9f-a85e-702aa920d41b" Jul 01 19:18:54.943635 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:54.943599 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:54.943826 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:54.943732 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:54.943826 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:54.943801 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret podName:ee155ec6-3ff7-4afe-a20d-f7ea9289fe00 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:26.943783231 +0000 UTC m=+66.124114776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret") pod "global-pull-secret-syncer-rcmnr" (UID: "ee155ec6-3ff7-4afe-a20d-f7ea9289fe00") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:18:55.044333 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.044293 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:55.044507 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.044347 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:55.044507 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.044494 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:55.044638 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.044525 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:18:55.044638 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.044546 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:18:55.044638 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.044558 2551 projected.go:196] Error preparing data for projected volume kube-api-access-kzwth for pod openshift-network-diagnostics/network-check-target-rbkmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:55.044638 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.044585 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs podName:7f2bd16e-ec4a-4b9f-a85e-702aa920d41b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:27.044557267 +0000 UTC m=+66.224888827 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs") pod "network-metrics-daemon-dp5wv" (UID: "7f2bd16e-ec4a-4b9f-a85e-702aa920d41b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:18:55.044638 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.044609 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth podName:1249ef53-37ad-47ac-bcc3-7377fdd3216c nodeName:}" failed. No retries permitted until 2026-07-01 19:19:27.044593528 +0000 UTC m=+66.224925085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzwth" (UniqueName: "kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth") pod "network-check-target-rbkmp" (UID: "1249ef53-37ad-47ac-bcc3-7377fdd3216c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:18:55.619868 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.619656 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-127.ec2.internal" event="NodeReady" Jul 01 19:18:55.620310 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.619985 2551 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:18:55.667530 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.667495 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-579f95945d-mht5z"] Jul 01 19:18:55.670060 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.670020 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.672205 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.672182 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jxkfq\"" Jul 01 19:18:55.673389 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.673365 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 19:18:55.673531 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.673518 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 19:18:55.673997 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.673832 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 19:18:55.679926 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.679898 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 19:18:55.680634 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.680613 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f9xcw"] Jul 01 19:18:55.682647 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.682631 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.685840 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.685678 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:18:55.686065 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.686037 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s225c\"" Jul 01 19:18:55.686478 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.686344 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:18:55.687907 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.687883 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v7p9d"] Jul 01 19:18:55.689632 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.689612 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-579f95945d-mht5z"] Jul 01 19:18:55.689754 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.689736 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v7p9d" Jul 01 19:18:55.692118 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.692090 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:18:55.692236 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.692190 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:18:55.692479 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.692460 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kpx6j\"" Jul 01 19:18:55.692667 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.692647 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:18:55.700514 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.700489 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f9xcw"] Jul 01 19:18:55.702899 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.702870 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v7p9d"] Jul 01 19:18:55.751397 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751282 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-certificates\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.751397 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751353 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vldp\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-kube-api-access-6vldp\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.751668 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751483 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-image-registry-private-configuration\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.751668 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751638 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-tmp-dir\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.751805 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751675 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.751805 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751767 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-bound-sa-token\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.751905 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751809 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-config-volume\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.751905 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751839 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-trusted-ca\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.751905 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751898 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.752040 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751918 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0b429bb-956a-4adb-aa22-ba581a9b9245-ca-trust-extracted\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.752040 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751936 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-installation-pull-secrets\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.752040 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.751967 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhj9j\" (UniqueName: \"kubernetes.io/projected/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-kube-api-access-fhj9j\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.839737 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.839679 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:55.852521 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.852488 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vldp\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-kube-api-access-6vldp\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.852722 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.852641 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-image-registry-private-configuration\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.852722 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.852675 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-tmp-dir\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.852722 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.852716 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06bda432-14d9-475e-9cbe-775b5a4e8722-cert\") pod \"ingress-canary-v7p9d\" (UID: \"06bda432-14d9-475e-9cbe-775b5a4e8722\") " pod="openshift-ingress-canary/ingress-canary-v7p9d" Jul 01 19:18:55.852887 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.852743 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.852887 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.852769 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4g8\" (UniqueName: \"kubernetes.io/projected/06bda432-14d9-475e-9cbe-775b5a4e8722-kube-api-access-vm4g8\") pod \"ingress-canary-v7p9d\" (UID: \"06bda432-14d9-475e-9cbe-775b5a4e8722\") " pod="openshift-ingress-canary/ingress-canary-v7p9d" Jul 01 19:18:55.852887 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.852835 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-bound-sa-token\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.852887 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.852859 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-config-volume\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.853079 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.852889 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:55.853079 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.852913 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-trusted-ca\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.853079 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.852966 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls podName:2b1e0076-dfbc-4a54-9393-3adb2b241e0b nodeName:}" failed. No retries permitted until 2026-07-01 19:18:56.352945072 +0000 UTC m=+35.533276633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls") pod "dns-default-f9xcw" (UID: "2b1e0076-dfbc-4a54-9393-3adb2b241e0b") : secret "dns-default-metrics-tls" not found Jul 01 19:18:55.853079 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853017 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.853079 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853036 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0b429bb-956a-4adb-aa22-ba581a9b9245-ca-trust-extracted\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.853079 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853053 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-installation-pull-secrets\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.853079 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853070 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhj9j\" (UniqueName: \"kubernetes.io/projected/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-kube-api-access-fhj9j\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.853404 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853086 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-certificates\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.853404 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853104 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-tmp-dir\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.853404 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853363 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-config-volume\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.853554 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.853428 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:55.853554 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.853445 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579f95945d-mht5z: secret "image-registry-tls" not found Jul 01 19:18:55.853554 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853475 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0b429bb-956a-4adb-aa22-ba581a9b9245-ca-trust-extracted\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.853554 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:55.853504 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls podName:c0b429bb-956a-4adb-aa22-ba581a9b9245 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:56.35348698 +0000 UTC m=+35.533818525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls") pod "image-registry-579f95945d-mht5z" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245") : secret "image-registry-tls" not found Jul 01 19:18:55.853735 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853579 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-certificates\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.853954 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.853929 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-trusted-ca\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.857530 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.857491 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-installation-pull-secrets\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.857660 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.857549 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-image-registry-private-configuration\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.865202 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.865172 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhj9j\" (UniqueName: \"kubernetes.io/projected/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-kube-api-access-fhj9j\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:55.865705 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.865663 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vldp\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-kube-api-access-6vldp\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.865812 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.865683 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-bound-sa-token\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:55.940799 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.940682 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:55.954062 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.954031 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06bda432-14d9-475e-9cbe-775b5a4e8722-cert\") pod \"ingress-canary-v7p9d\" (UID: \"06bda432-14d9-475e-9cbe-775b5a4e8722\") " pod="openshift-ingress-canary/ingress-canary-v7p9d" Jul 01 19:18:55.954262 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.954078 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4g8\" (UniqueName: \"kubernetes.io/projected/06bda432-14d9-475e-9cbe-775b5a4e8722-kube-api-access-vm4g8\") pod \"ingress-canary-v7p9d\" (UID: \"06bda432-14d9-475e-9cbe-775b5a4e8722\") " pod="openshift-ingress-canary/ingress-canary-v7p9d" Jul 01 19:18:55.956760 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.956734 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06bda432-14d9-475e-9cbe-775b5a4e8722-cert\") pod \"ingress-canary-v7p9d\" (UID: \"06bda432-14d9-475e-9cbe-775b5a4e8722\") " pod="openshift-ingress-canary/ingress-canary-v7p9d" Jul 01 19:18:55.962992 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:55.962956 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4g8\" (UniqueName: \"kubernetes.io/projected/06bda432-14d9-475e-9cbe-775b5a4e8722-kube-api-access-vm4g8\") pod \"ingress-canary-v7p9d\" (UID: \"06bda432-14d9-475e-9cbe-775b5a4e8722\") " pod="openshift-ingress-canary/ingress-canary-v7p9d" Jul 01 19:18:56.002015 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.001971 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v7p9d" Jul 01 19:18:56.250201 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.250120 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:18:56.250342 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.250120 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:18:56.250440 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.250120 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:18:56.252760 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.252736 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7lk2\"" Jul 01 19:18:56.252760 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.252758 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:18:56.252976 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.252890 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:18:56.252976 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.252921 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:18:56.253167 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.253152 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hpww\"" Jul 01 19:18:56.253245 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.253213 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:18:56.357127 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.357087 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:56.357325 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.357214 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:56.357325 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:56.357281 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:56.357325 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:56.357311 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:56.357325 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:56.357325 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579f95945d-mht5z: secret "image-registry-tls" not found Jul 01 19:18:56.357581 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:56.357362 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls podName:2b1e0076-dfbc-4a54-9393-3adb2b241e0b nodeName:}" failed. No retries permitted until 2026-07-01 19:18:57.357341526 +0000 UTC m=+36.537673072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls") pod "dns-default-f9xcw" (UID: "2b1e0076-dfbc-4a54-9393-3adb2b241e0b") : secret "dns-default-metrics-tls" not found Jul 01 19:18:56.357581 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:56.357385 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls podName:c0b429bb-956a-4adb-aa22-ba581a9b9245 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:57.357368884 +0000 UTC m=+36.537700430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls") pod "image-registry-579f95945d-mht5z" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245") : secret "image-registry-tls" not found Jul 01 19:18:56.719938 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:56.719898 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v7p9d"] Jul 01 19:18:56.723576 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:18:56.723550 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bda432_14d9_475e_9cbe_775b5a4e8722.slice/crio-4ef501d80d60c96bcb254e000851eee5b813b09acb4bbb896805cafea5a80a64 WatchSource:0}: Error finding container 4ef501d80d60c96bcb254e000851eee5b813b09acb4bbb896805cafea5a80a64: Status 404 returned error can't find the container with id 4ef501d80d60c96bcb254e000851eee5b813b09acb4bbb896805cafea5a80a64 Jul 01 19:18:57.365237 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:57.365187 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:57.365237 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:57.365252 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:57.365500 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:57.365357 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:57.365500 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:57.365365 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:57.365500 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:57.365384 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579f95945d-mht5z: secret "image-registry-tls" not found Jul 01 19:18:57.365500 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:57.365411 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls podName:2b1e0076-dfbc-4a54-9393-3adb2b241e0b nodeName:}" failed. No retries permitted until 2026-07-01 19:18:59.365398013 +0000 UTC m=+38.545729559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls") pod "dns-default-f9xcw" (UID: "2b1e0076-dfbc-4a54-9393-3adb2b241e0b") : secret "dns-default-metrics-tls" not found Jul 01 19:18:57.365500 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:57.365435 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls podName:c0b429bb-956a-4adb-aa22-ba581a9b9245 nodeName:}" failed. No retries permitted until 2026-07-01 19:18:59.365418662 +0000 UTC m=+38.545750204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls") pod "image-registry-579f95945d-mht5z" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245") : secret "image-registry-tls" not found Jul 01 19:18:57.434974 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:57.434899 2551 generic.go:356] "Generic (PLEG): container finished" podID="71176e9a-093c-45ea-ac85-dbeb77c94b9f" containerID="2ce83f4be48bbd7fe495c0c9391ca1744e492dffb4b7db9b3315c2e89680e10b" exitCode=0 Jul 01 19:18:57.434974 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:57.434947 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97zfk" event={"ID":"71176e9a-093c-45ea-ac85-dbeb77c94b9f","Type":"ContainerDied","Data":"2ce83f4be48bbd7fe495c0c9391ca1744e492dffb4b7db9b3315c2e89680e10b"} Jul 01 19:18:57.436417 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:57.436394 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v7p9d" event={"ID":"06bda432-14d9-475e-9cbe-775b5a4e8722","Type":"ContainerStarted","Data":"4ef501d80d60c96bcb254e000851eee5b813b09acb4bbb896805cafea5a80a64"} Jul 01 19:18:58.443510 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:58.443445 2551 generic.go:356] "Generic (PLEG): container finished" podID="71176e9a-093c-45ea-ac85-dbeb77c94b9f" containerID="d49bf2658e45ec49b1ba00d52c3a419d210ee6183919d42501a4de622babc5c0" exitCode=0 Jul 01 19:18:58.443510 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:58.443486 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97zfk" event={"ID":"71176e9a-093c-45ea-ac85-dbeb77c94b9f","Type":"ContainerDied","Data":"d49bf2658e45ec49b1ba00d52c3a419d210ee6183919d42501a4de622babc5c0"} Jul 01 19:18:58.448359 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:58.448331 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:58.508543 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:58.508508 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:59.211246 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.211202 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:59.311891 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.311853 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:59.382712 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.382649 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:18:59.382888 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.382726 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:18:59.382888 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:59.382818 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:18:59.382888 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:59.382832 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:18:59.382888 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:59.382839 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579f95945d-mht5z: secret "image-registry-tls" not found Jul 01 19:18:59.382888 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:59.382883 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls podName:2b1e0076-dfbc-4a54-9393-3adb2b241e0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:03.382871186 +0000 UTC m=+42.563202728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls") pod "dns-default-f9xcw" (UID: "2b1e0076-dfbc-4a54-9393-3adb2b241e0b") : secret "dns-default-metrics-tls" not found Jul 01 19:18:59.383132 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:59.382898 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls podName:c0b429bb-956a-4adb-aa22-ba581a9b9245 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:03.382891543 +0000 UTC m=+42.563223085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls") pod "image-registry-579f95945d-mht5z" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245") : secret "image-registry-tls" not found Jul 01 19:18:59.408252 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.408218 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ft7dh"] Jul 01 19:18:59.413730 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.413712 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.416166 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.416137 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:18:59.416414 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.416396 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:18:59.417153 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.417135 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lgxdz\"" Jul 01 19:18:59.417153 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.417147 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:18:59.417288 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.417145 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:18:59.423398 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.423371 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ft7dh"] Jul 01 19:18:59.447473 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.447432 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:59.450430 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.450399 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97zfk" event={"ID":"71176e9a-093c-45ea-ac85-dbeb77c94b9f","Type":"ContainerStarted","Data":"fee2f404253c32de3b0ad5cf3d4057f8bd189931fa0c28c683c2f51714df261a"} Jul 01 19:18:59.473123 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.473076 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-97zfk" podStartSLOduration=8.264237226 podStartE2EDuration="38.473059069s" totalImagesPullingTime="30.208821843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:18:59.471357755 +0000 UTC m=+38.651689333" watchObservedRunningTime="2026-07-01 19:18:59.473059069 +0000 UTC m=+38.653390633" Jul 01 19:18:59.520049 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.520015 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:59.584762 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.584721 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-crio-socket\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.584935 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.584783 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.584935 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.584821 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5tps\" (UniqueName: \"kubernetes.io/projected/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-api-access-v5tps\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.584935 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.584891 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.585106 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.585042 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-data-volume\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.612848 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.612812 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:59.686155 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.686116 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-crio-socket\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.686155 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.686156 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.686405 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.686174 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5tps\" (UniqueName: \"kubernetes.io/projected/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-api-access-v5tps\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.686405 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.686252 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.686405 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.686362 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-data-volume\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.686505 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.686411 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-crio-socket\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.686505 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:59.686264 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:18:59.686505 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:59.686337 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:18:59.686505 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:59.686493 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:00.186478332 +0000 UTC m=+39.366809877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : configmap "kube-rbac-proxy" not found Jul 01 19:18:59.686622 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:18:59.686525 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:00.186511774 +0000 UTC m=+39.366843316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : secret "insights-runtime-extractor-tls" not found Jul 01 19:18:59.686749 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.686727 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-data-volume\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.696997 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.696965 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5tps\" (UniqueName: \"kubernetes.io/projected/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-api-access-v5tps\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:18:59.749661 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.749570 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:59.813086 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.813060 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:59.894186 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.894144 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:18:59.994826 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:18:59.994787 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:00.190880 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:00.190847 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:00.190880 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:00.190886 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:00.191177 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:00.191012 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:00.191177 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:00.191098 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:01.191076361 +0000 UTC m=+40.371407910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : configmap "kube-rbac-proxy" not found Jul 01 19:19:00.191177 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:00.191017 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:00.191177 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:00.191145 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:01.191134774 +0000 UTC m=+40.371466320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:00.226419 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:00.226384 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:00.318599 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:00.318569 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:00.454228 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:00.454134 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v7p9d" event={"ID":"06bda432-14d9-475e-9cbe-775b5a4e8722","Type":"ContainerStarted","Data":"dcebca44f23a2739ab2e74e3d25292b36ddf2316b0f6c7282225ea869b08958d"} Jul 01 19:19:00.472603 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:00.472553 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v7p9d" podStartSLOduration=2.767696114 podStartE2EDuration="5.472536446s" totalImagesPullingTime="2.704840332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:00.472350184 +0000 UTC m=+39.652681769" watchObservedRunningTime="2026-07-01 19:19:00.472536446 +0000 UTC m=+39.652867988" Jul 01 19:19:01.199093 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:01.199050 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:01.199093 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:01.199097 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:01.199338 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:01.199168 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:01.199338 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:01.199183 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:01.199338 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:01.199230 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:03.199215409 +0000 UTC m=+42.379546951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:01.199338 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:01.199258 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:03.199252179 +0000 UTC m=+42.379583720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : configmap "kube-rbac-proxy" not found Jul 01 19:19:01.520763 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:01.520669 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:01.577060 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:01.577034 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ntmhl_71cba711-068b-41aa-a58c-69836410353e/dns-node-resolver/0.log" Jul 01 19:19:01.579883 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:01.579858 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:02.525180 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:02.525141 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:02.577370 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:02.577348 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s4knf_5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506/node-ca/0.log" Jul 01 19:19:03.177333 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:03.177307 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v7p9d_06bda432-14d9-475e-9cbe-775b5a4e8722/serve-healthcheck-canary/0.log" Jul 01 19:19:03.215893 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:03.215852 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:03.215893 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:03.215899 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:03.216103 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:03.215983 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:03.216103 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:03.216028 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:03.216103 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:03.216048 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:07.216031399 +0000 UTC m=+46.396362942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : configmap "kube-rbac-proxy" not found Jul 01 19:19:03.216103 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:03.216068 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:07.21605632 +0000 UTC m=+46.396387866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:03.416705 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:03.416665 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:19:03.416908 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:03.416753 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:19:03.416908 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:03.416845 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:19:03.416908 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:03.416877 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579f95945d-mht5z: secret "image-registry-tls" not found Jul 01 19:19:03.417047 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:03.416939 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls podName:c0b429bb-956a-4adb-aa22-ba581a9b9245 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:11.416919722 +0000 UTC m=+50.597251277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls") pod "image-registry-579f95945d-mht5z" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245") : secret "image-registry-tls" not found Jul 01 19:19:03.417047 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:03.416852 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:19:03.417047 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:03.416976 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls podName:2b1e0076-dfbc-4a54-9393-3adb2b241e0b nodeName:}" failed. No retries permitted until 2026-07-01 19:19:11.416966647 +0000 UTC m=+50.597298201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls") pod "dns-default-f9xcw" (UID: "2b1e0076-dfbc-4a54-9393-3adb2b241e0b") : secret "dns-default-metrics-tls" not found Jul 01 19:19:03.881389 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:03.881347 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:03.949036 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:03.949003 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:05.366633 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:05.366599 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:06.790845 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:06.790811 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:06.936926 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:06.936884 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:07.038326 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:07.038295 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:07.150744 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:07.150712 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:07.248547 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:07.248515 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:07.248720 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:07.248556 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:07.248720 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:07.248634 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:19:07.248720 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:07.248661 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:07.248825 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:07.248723 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:15.248685169 +0000 UTC m=+54.429016771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : configmap "kube-rbac-proxy" not found Jul 01 19:19:07.248825 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:07.248738 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:15.248732057 +0000 UTC m=+54.429063600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:07.270070 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:07.270035 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:07.378961 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:07.378926 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:07.477503 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:07.477420 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:08.299850 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:08.299813 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:08.675084 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:08.675055 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:09.080568 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:09.080446 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:09.278202 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:09.278155 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:09.707488 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:09.707454 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:10.487594 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:10.487561 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:10.670482 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:10.670450 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:10.770741 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:10.770634 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:11.077099 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.077013 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:11.281057 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.281018 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:11.336359 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.336269 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:11.481165 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.481134 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:11.482047 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.482024 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:19:11.482169 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.482116 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:19:11.484353 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.484336 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b1e0076-dfbc-4a54-9393-3adb2b241e0b-metrics-tls\") pod \"dns-default-f9xcw\" (UID: \"2b1e0076-dfbc-4a54-9393-3adb2b241e0b\") " pod="openshift-dns/dns-default-f9xcw" Jul 01 19:19:11.488350 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.488329 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") pod \"image-registry-579f95945d-mht5z\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:19:11.582283 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.582236 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:19:11.593580 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.593506 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9xcw" Jul 01 19:19:11.729154 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.729123 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-579f95945d-mht5z"] Jul 01 19:19:11.732479 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:11.732445 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b429bb_956a_4adb_aa22_ba581a9b9245.slice/crio-07c1821dd8873e9b7647e8780ced53bc205c06e1f8baffaa0b15eafb1ce4b0e1 WatchSource:0}: Error finding container 07c1821dd8873e9b7647e8780ced53bc205c06e1f8baffaa0b15eafb1ce4b0e1: Status 404 returned error can't find the container with id 07c1821dd8873e9b7647e8780ced53bc205c06e1f8baffaa0b15eafb1ce4b0e1 Jul 01 19:19:11.744354 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:11.744329 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f9xcw"] Jul 01 19:19:11.747175 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:11.747153 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1e0076_dfbc_4a54_9393_3adb2b241e0b.slice/crio-df7f6850281551261fa0f90ad4a877aa3e33e5701c7c78eced623d64adc1155e WatchSource:0}: Error finding container df7f6850281551261fa0f90ad4a877aa3e33e5701c7c78eced623d64adc1155e: Status 404 returned error can't find the container with id df7f6850281551261fa0f90ad4a877aa3e33e5701c7c78eced623d64adc1155e Jul 01 19:19:12.252811 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.252775 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:12.475131 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.475088 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:12.485475 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.485427 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9xcw" event={"ID":"2b1e0076-dfbc-4a54-9393-3adb2b241e0b","Type":"ContainerStarted","Data":"df7f6850281551261fa0f90ad4a877aa3e33e5701c7c78eced623d64adc1155e"} Jul 01 19:19:12.487246 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.487210 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579f95945d-mht5z" event={"ID":"c0b429bb-956a-4adb-aa22-ba581a9b9245","Type":"ContainerStarted","Data":"74e37b97a5f193338cf9efedd7d854a45943f7b29f61023d3415d6a68f17b413"} Jul 01 19:19:12.487382 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.487261 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579f95945d-mht5z" event={"ID":"c0b429bb-956a-4adb-aa22-ba581a9b9245","Type":"ContainerStarted","Data":"07c1821dd8873e9b7647e8780ced53bc205c06e1f8baffaa0b15eafb1ce4b0e1"} Jul 01 19:19:12.487382 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.487320 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:19:12.511302 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.511202 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-579f95945d-mht5z" podStartSLOduration=22.511181561 podStartE2EDuration="22.511181561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:12.509727859 +0000 UTC m=+51.690059452" watchObservedRunningTime="2026-07-01 19:19:12.511181561 +0000 UTC m=+51.691513128" Jul 01 19:19:12.798836 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.798728 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:12.899354 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.899322 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:12.959196 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:12.959161 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:13.113497 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:13.113465 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:13.214883 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:13.214846 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:13.316570 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:13.316533 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:13.471333 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:13.471241 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:13.572246 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:13.572198 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:13.673013 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:13.672978 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:13.765256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:13.765166 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:13.840545 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:13.840521 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:13.938968 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:13.938933 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:14.282413 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:14.282303 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:14.493107 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:14.493074 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9xcw" event={"ID":"2b1e0076-dfbc-4a54-9393-3adb2b241e0b","Type":"ContainerStarted","Data":"25fa2bcbc82e720c37be71182b288280e7f00bba268cecc18da668b56a4354f5"} Jul 01 19:19:14.493506 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:14.493124 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9xcw" event={"ID":"2b1e0076-dfbc-4a54-9393-3adb2b241e0b","Type":"ContainerStarted","Data":"0656f717d20d7ca21406dbd2fdeceecca597889dd9254fbd9a7a5620c82f19f2"} Jul 01 19:19:14.493506 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:14.493211 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f9xcw" Jul 01 19:19:14.509125 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:14.509072 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f9xcw" podStartSLOduration=17.437804911 podStartE2EDuration="19.509057676s" totalImagesPullingTime="2.071252765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:14.508108571 +0000 UTC m=+53.688440134" watchObservedRunningTime="2026-07-01 19:19:14.509057676 +0000 UTC m=+53.689389234" Jul 01 19:19:14.675276 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:14.675243 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:14.739143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:14.739113 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:14.878872 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:14.878842 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:15.125416 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:15.125381 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:15.282180 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:15.282141 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:15.311956 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:15.311922 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:15.312137 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:15.311964 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:15.312137 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:15.312068 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:19:15.312137 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:15.312123 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls podName:aa6ef8b3-cc6e-461d-93b3-fa84d99efaef nodeName:}" failed. No retries permitted until 2026-07-01 19:19:31.312110773 +0000 UTC m=+70.492442315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft7dh" (UID: "aa6ef8b3-cc6e-461d-93b3-fa84d99efaef") : secret "insights-runtime-extractor-tls" not found Jul 01 19:19:15.312523 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:15.312499 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:15.528962 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:15.528872 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:15.629138 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:15.629097 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:15.877148 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:15.877126 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:16.480597 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:16.480560 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:16.680508 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:16.680469 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:16.883619 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:16.883584 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:17.096210 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:17.096177 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:17.736865 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:17.736826 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:17.877549 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:17.877510 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:20.422558 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:20.422529 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggrjp" Jul 01 19:19:20.848551 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:20.848467 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:20.916147 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:20.916116 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:21.128331 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:21.128294 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:22.538219 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:22.538189 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:22.593133 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:22.593101 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:23.318842 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.318812 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd"] Jul 01 19:19:23.321752 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.321733 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.324495 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.324474 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 19:19:23.324808 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.324790 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 19:19:23.324904 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.324796 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 19:19:23.326739 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.326720 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 19:19:23.336841 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.336816 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn"] Jul 01 19:19:23.338925 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.338906 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd"] Jul 01 19:19:23.339023 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.339001 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.342841 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.342822 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 19:19:23.342962 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.342860 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 19:19:23.342962 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.342872 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 19:19:23.343081 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.342980 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 19:19:23.353266 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.353243 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn"] Jul 01 19:19:23.358201 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.358176 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-579f95945d-mht5z"] Jul 01 19:19:23.375299 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.375269 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53ff589a-1706-4972-80e8-f57eedd75a52-klusterlet-config\") pod \"klusterlet-addon-workmgr-857b5b6696-mgrfd\" (UID: \"53ff589a-1706-4972-80e8-f57eedd75a52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.375445 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.375321 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.375445 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.375345 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.375445 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.375387 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5l5f\" (UniqueName: \"kubernetes.io/projected/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-kube-api-access-d5l5f\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.375545 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.375481 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-ca\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.375545 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.375501 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jzdz\" (UniqueName: \"kubernetes.io/projected/53ff589a-1706-4972-80e8-f57eedd75a52-kube-api-access-2jzdz\") pod \"klusterlet-addon-workmgr-857b5b6696-mgrfd\" (UID: \"53ff589a-1706-4972-80e8-f57eedd75a52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.375545 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.375523 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.375652 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.375568 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53ff589a-1706-4972-80e8-f57eedd75a52-tmp\") pod \"klusterlet-addon-workmgr-857b5b6696-mgrfd\" (UID: \"53ff589a-1706-4972-80e8-f57eedd75a52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.375652 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.375591 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-hub\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.450139 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.450102 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:23.476070 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476031 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5l5f\" (UniqueName: \"kubernetes.io/projected/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-kube-api-access-d5l5f\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.476313 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476121 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-ca\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.476313 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476148 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jzdz\" (UniqueName: \"kubernetes.io/projected/53ff589a-1706-4972-80e8-f57eedd75a52-kube-api-access-2jzdz\") pod \"klusterlet-addon-workmgr-857b5b6696-mgrfd\" (UID: \"53ff589a-1706-4972-80e8-f57eedd75a52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.476313 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476181 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.476313 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476216 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53ff589a-1706-4972-80e8-f57eedd75a52-tmp\") pod \"klusterlet-addon-workmgr-857b5b6696-mgrfd\" (UID: \"53ff589a-1706-4972-80e8-f57eedd75a52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.476313 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476238 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-hub\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.476313 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476274 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53ff589a-1706-4972-80e8-f57eedd75a52-klusterlet-config\") pod \"klusterlet-addon-workmgr-857b5b6696-mgrfd\" (UID: \"53ff589a-1706-4972-80e8-f57eedd75a52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.476621 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476319 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.476621 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476438 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.476771 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.476745 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53ff589a-1706-4972-80e8-f57eedd75a52-tmp\") pod \"klusterlet-addon-workmgr-857b5b6696-mgrfd\" (UID: \"53ff589a-1706-4972-80e8-f57eedd75a52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.477074 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.477055 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.478899 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.478847 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.479242 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.479222 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.479306 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.479239 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-ca\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.479306 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.479278 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-hub\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.479410 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.479364 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53ff589a-1706-4972-80e8-f57eedd75a52-klusterlet-config\") pod \"klusterlet-addon-workmgr-857b5b6696-mgrfd\" (UID: \"53ff589a-1706-4972-80e8-f57eedd75a52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.489519 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.489490 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5l5f\" (UniqueName: \"kubernetes.io/projected/a61d63d8-9c4e-41c9-a0d4-01273d7583ae-kube-api-access-d5l5f\") pod \"cluster-proxy-proxy-agent-5f98746488-k8jkn\" (UID: \"a61d63d8-9c4e-41c9-a0d4-01273d7583ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.490027 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.490007 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jzdz\" (UniqueName: \"kubernetes.io/projected/53ff589a-1706-4972-80e8-f57eedd75a52-kube-api-access-2jzdz\") pod \"klusterlet-addon-workmgr-857b5b6696-mgrfd\" (UID: \"53ff589a-1706-4972-80e8-f57eedd75a52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.563623 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.563582 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:23.630632 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.630604 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:23.656123 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.656086 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" Jul 01 19:19:23.737200 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.737115 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:23.786760 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.786728 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd"] Jul 01 19:19:23.789430 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:23.789406 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ff589a_1706_4972_80e8_f57eedd75a52.slice/crio-3e638c24d4db875b800063c954c4f43d3ca8b80d5931ad2de9ac7ce76e7caea0 WatchSource:0}: Error finding container 3e638c24d4db875b800063c954c4f43d3ca8b80d5931ad2de9ac7ce76e7caea0: Status 404 returned error can't find the container with id 3e638c24d4db875b800063c954c4f43d3ca8b80d5931ad2de9ac7ce76e7caea0 Jul 01 19:19:23.818656 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.818633 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn"] Jul 01 19:19:23.820831 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:23.820798 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda61d63d8_9c4e_41c9_a0d4_01273d7583ae.slice/crio-c6bb4999c8aa3497d465ba44deeaf796343082fb872378a4cd7bbc41efd45a22 WatchSource:0}: Error finding container c6bb4999c8aa3497d465ba44deeaf796343082fb872378a4cd7bbc41efd45a22: Status 404 returned error can't find the container with id c6bb4999c8aa3497d465ba44deeaf796343082fb872378a4cd7bbc41efd45a22 Jul 01 19:19:23.880249 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.880219 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:23.999305 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:23.999224 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:24.497482 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:24.497451 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f9xcw" Jul 01 19:19:24.519433 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:24.519387 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" event={"ID":"53ff589a-1706-4972-80e8-f57eedd75a52","Type":"ContainerStarted","Data":"3e638c24d4db875b800063c954c4f43d3ca8b80d5931ad2de9ac7ce76e7caea0"} Jul 01 19:19:24.520542 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:24.520513 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" event={"ID":"a61d63d8-9c4e-41c9-a0d4-01273d7583ae","Type":"ContainerStarted","Data":"c6bb4999c8aa3497d465ba44deeaf796343082fb872378a4cd7bbc41efd45a22"} Jul 01 19:19:24.770814 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:24.770723 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:25.196929 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:25.196892 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:25.295350 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:25.295317 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:25.645607 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:25.645567 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:25.749441 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:25.749408 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:25.931793 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:25.931677 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:26.028861 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:26.028824 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:26.393014 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:26.392978 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:26.493188 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:26.493155 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:27.006257 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.006214 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:19:27.009266 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.009242 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:19:27.019936 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.019908 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee155ec6-3ff7-4afe-a20d-f7ea9289fe00-original-pull-secret\") pod \"global-pull-secret-syncer-rcmnr\" (UID: \"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00\") " pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:19:27.107440 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.107396 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:19:27.107720 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.107452 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:19:27.111395 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.111371 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:19:27.111595 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.111573 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:19:27.120324 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.120293 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f2bd16e-ec4a-4b9f-a85e-702aa920d41b-metrics-certs\") pod \"network-metrics-daemon-dp5wv\" (UID: \"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b\") " pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:19:27.120758 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.120740 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:19:27.130456 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.130432 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzwth\" (UniqueName: \"kubernetes.io/projected/1249ef53-37ad-47ac-bcc3-7377fdd3216c-kube-api-access-kzwth\") pod \"network-check-target-rbkmp\" (UID: \"1249ef53-37ad-47ac-bcc3-7377fdd3216c\") " pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:19:27.163963 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.163938 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7lk2\"" Jul 01 19:19:27.167012 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.166984 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcmnr" Jul 01 19:19:27.171591 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.171567 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dp5wv" Jul 01 19:19:27.175553 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.175531 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hpww\"" Jul 01 19:19:27.183748 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.183701 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:19:27.350798 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.350679 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:27.421332 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:27.421289 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:28.202532 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:28.202502 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbkmp"] Jul 01 19:19:28.206114 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:28.206086 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1249ef53_37ad_47ac_bcc3_7377fdd3216c.slice/crio-9dda910e922558b83ca9343e299dda830c92974903a8f31e27490f7b68812607 WatchSource:0}: Error finding container 9dda910e922558b83ca9343e299dda830c92974903a8f31e27490f7b68812607: Status 404 returned error can't find the container with id 9dda910e922558b83ca9343e299dda830c92974903a8f31e27490f7b68812607 Jul 01 19:19:28.427141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:28.426978 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rcmnr"] Jul 01 19:19:28.431920 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:28.431893 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dp5wv"] Jul 01 19:19:28.482921 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:28.482879 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee155ec6_3ff7_4afe_a20d_f7ea9289fe00.slice/crio-b5a164e65dc97682def2118d0daae9824485bab7e78d705743d4ba60b72139b7 WatchSource:0}: Error finding container b5a164e65dc97682def2118d0daae9824485bab7e78d705743d4ba60b72139b7: Status 404 returned error can't find the container with id b5a164e65dc97682def2118d0daae9824485bab7e78d705743d4ba60b72139b7 Jul 01 19:19:28.483537 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:28.483491 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2bd16e_ec4a_4b9f_a85e_702aa920d41b.slice/crio-4a2ca6b11a3c5b41969403e8febb859bc165c00fe6f142ab1994e674fcf823ed WatchSource:0}: Error finding container 4a2ca6b11a3c5b41969403e8febb859bc165c00fe6f142ab1994e674fcf823ed: Status 404 returned error can't find the container with id 4a2ca6b11a3c5b41969403e8febb859bc165c00fe6f142ab1994e674fcf823ed Jul 01 19:19:28.533122 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:28.533090 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dp5wv" event={"ID":"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b","Type":"ContainerStarted","Data":"4a2ca6b11a3c5b41969403e8febb859bc165c00fe6f142ab1994e674fcf823ed"} Jul 01 19:19:28.534104 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:28.534076 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbkmp" event={"ID":"1249ef53-37ad-47ac-bcc3-7377fdd3216c","Type":"ContainerStarted","Data":"9dda910e922558b83ca9343e299dda830c92974903a8f31e27490f7b68812607"} Jul 01 19:19:28.535057 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:28.535035 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rcmnr" event={"ID":"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00","Type":"ContainerStarted","Data":"b5a164e65dc97682def2118d0daae9824485bab7e78d705743d4ba60b72139b7"} Jul 01 19:19:29.328613 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:29.328533 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:29.519702 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:29.519647 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:29.541866 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:29.541555 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" event={"ID":"53ff589a-1706-4972-80e8-f57eedd75a52","Type":"ContainerStarted","Data":"f558db1e6c2282fb1317918a8a42bf757d024d7b5416468be3b3bab0eb4b943f"} Jul 01 19:19:29.541866 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:29.541838 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:29.543638 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:29.543613 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" Jul 01 19:19:29.578844 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:29.578674 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857b5b6696-mgrfd" podStartSLOduration=1.84976908 podStartE2EDuration="6.578651007s" totalImagesPullingTime="4.728881927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:29.560809065 +0000 UTC m=+68.741140629" watchObservedRunningTime="2026-07-01 19:19:29.578651007 +0000 UTC m=+68.758982572" Jul 01 19:19:30.547571 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:30.547482 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dp5wv" event={"ID":"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b","Type":"ContainerStarted","Data":"bbd7eb7eb8bf2bdedd70e7f11dbd2560985f8db232527a4372907fc3bd9c8454"} Jul 01 19:19:30.970175 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:30.970139 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:31.060210 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.060170 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:31.340017 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.339832 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:31.343333 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.343300 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa6ef8b3-cc6e-461d-93b3-fa84d99efaef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft7dh\" (UID: \"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef\") " pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:31.361501 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.361409 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:31.511762 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.511723 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:31.526456 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.526427 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lgxdz\"" Jul 01 19:19:31.534185 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.534167 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ft7dh" Jul 01 19:19:31.553504 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.553459 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dp5wv" event={"ID":"7f2bd16e-ec4a-4b9f-a85e-702aa920d41b","Type":"ContainerStarted","Data":"e23e2d28be5afc0c0f38e2a03741d1e6b95b2c5344fb2d1d721698f315d3e6fe"} Jul 01 19:19:31.571873 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.571820 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dp5wv" podStartSLOduration=68.764847566 podStartE2EDuration="1m10.571804424s" totalImagesPullingTime="1.806956858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:31.570925162 +0000 UTC m=+70.751256745" watchObservedRunningTime="2026-07-01 19:19:31.571804424 +0000 UTC m=+70.752135982" Jul 01 19:19:31.612147 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.612111 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:31.732536 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.732498 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:31.830256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.830212 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:31.929708 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:31.929595 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:32.066815 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:32.066780 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:32.172655 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:32.172620 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:33.364800 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:33.364768 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:19:33.536732 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:33.536655 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:33.635449 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:33.635358 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:33.843607 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:33.843502 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:33.907678 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:33.907628 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ft7dh"] Jul 01 19:19:33.910670 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:33.910645 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6ef8b3_cc6e_461d_93b3_fa84d99efaef.slice/crio-915034d1ae924827e9d24961c97b7e748234c17bad831d1d830b815970cc1675 WatchSource:0}: Error finding container 915034d1ae924827e9d24961c97b7e748234c17bad831d1d830b815970cc1675: Status 404 returned error can't find the container with id 915034d1ae924827e9d24961c97b7e748234c17bad831d1d830b815970cc1675 Jul 01 19:19:33.988419 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:33.988384 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:34.564683 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:34.564648 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbkmp" event={"ID":"1249ef53-37ad-47ac-bcc3-7377fdd3216c","Type":"ContainerStarted","Data":"c774856cc16c004ccba2b8c79036adf71b58d738363f49c346e6c826bb32650b"} Jul 01 19:19:34.565143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:34.564736 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:19:34.566164 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:34.566141 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rcmnr" event={"ID":"ee155ec6-3ff7-4afe-a20d-f7ea9289fe00","Type":"ContainerStarted","Data":"3dfcdb400b0d76566c5cf94c90e641f76b81985f9d13a82f110ccec05102fac0"} Jul 01 19:19:34.567119 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:34.567101 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ft7dh" event={"ID":"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef","Type":"ContainerStarted","Data":"915034d1ae924827e9d24961c97b7e748234c17bad831d1d830b815970cc1675"} Jul 01 19:19:34.582362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:34.582309 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rbkmp" podStartSLOduration=68.022459271 podStartE2EDuration="1m13.582294011s" totalImagesPullingTime="5.55983474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:34.582069124 +0000 UTC m=+73.762400693" watchObservedRunningTime="2026-07-01 19:19:34.582294011 +0000 UTC m=+73.762625574" Jul 01 19:19:34.597139 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:34.597097 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rcmnr" podStartSLOduration=68.327760375 podStartE2EDuration="1m13.59708225s" totalImagesPullingTime="5.269321875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:34.596623606 +0000 UTC m=+73.776955194" watchObservedRunningTime="2026-07-01 19:19:34.59708225 +0000 UTC m=+73.777413814" Jul 01 19:19:34.712643 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:34.712597 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:34.817837 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:34.817734 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:37.951980 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:37.951923 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:38.048875 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:38.048841 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:38.150239 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:38.150206 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:38.315456 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:38.315361 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:38.419426 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:38.419396 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:38.582866 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:38.582779 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ft7dh" event={"ID":"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef","Type":"ContainerStarted","Data":"72e98ae44921f0bbfef9271f65a5038d46e6e4dcdb052f45e7bd49f64d25382b"} Jul 01 19:19:39.588263 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:39.588221 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ft7dh" event={"ID":"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef","Type":"ContainerStarted","Data":"499c9ed3b3a8752c4a6f658363b4ac67e6f8bfabfbc5369db835b1695f7e7923"} Jul 01 19:19:41.596621 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:41.596579 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ft7dh" event={"ID":"aa6ef8b3-cc6e-461d-93b3-fa84d99efaef","Type":"ContainerStarted","Data":"e97946be62ad9b047e88b3f0da4952802a3342c07eec7451b8dc1019f55ee2f3"} Jul 01 19:19:41.622080 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:41.622004 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ft7dh" podStartSLOduration=35.288968292 podStartE2EDuration="42.621987972s" totalImagesPullingTime="7.33301968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:18:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:41.620775512 +0000 UTC m=+80.801107103" watchObservedRunningTime="2026-07-01 19:19:41.621987972 +0000 UTC m=+80.802319541" Jul 01 19:19:41.839266 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:41.839184 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:41.964299 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:41.964258 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:42.526149 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:42.526119 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:42.593863 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:42.593829 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:45.833527 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:45.833491 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:45.886593 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:45.886561 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:46.019140 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:46.019107 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:46.106570 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:46.106469 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:47.343562 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:47.343518 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:48.385393 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.385352 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-579f95945d-mht5z" podUID="c0b429bb-956a-4adb-aa22-ba581a9b9245" containerName="registry" containerID="cri-o://74e37b97a5f193338cf9efedd7d854a45943f7b29f61023d3415d6a68f17b413" gracePeriod=30 Jul 01 19:19:48.621717 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.621672 2551 generic.go:356] "Generic (PLEG): container finished" podID="c0b429bb-956a-4adb-aa22-ba581a9b9245" containerID="74e37b97a5f193338cf9efedd7d854a45943f7b29f61023d3415d6a68f17b413" exitCode=0 Jul 01 19:19:48.621870 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.621726 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579f95945d-mht5z" event={"ID":"c0b429bb-956a-4adb-aa22-ba581a9b9245","Type":"ContainerDied","Data":"74e37b97a5f193338cf9efedd7d854a45943f7b29f61023d3415d6a68f17b413"} Jul 01 19:19:48.621870 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.621776 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579f95945d-mht5z" event={"ID":"c0b429bb-956a-4adb-aa22-ba581a9b9245","Type":"ContainerDied","Data":"07c1821dd8873e9b7647e8780ced53bc205c06e1f8baffaa0b15eafb1ce4b0e1"} Jul 01 19:19:48.621870 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.621790 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07c1821dd8873e9b7647e8780ced53bc205c06e1f8baffaa0b15eafb1ce4b0e1" Jul 01 19:19:48.624723 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.624704 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:19:48.777745 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.777637 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-trusted-ca\") pod \"c0b429bb-956a-4adb-aa22-ba581a9b9245\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " Jul 01 19:19:48.777745 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.777681 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-image-registry-private-configuration\") pod \"c0b429bb-956a-4adb-aa22-ba581a9b9245\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " Jul 01 19:19:48.777745 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.777739 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-bound-sa-token\") pod \"c0b429bb-956a-4adb-aa22-ba581a9b9245\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " Jul 01 19:19:48.778019 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.777856 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vldp\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-kube-api-access-6vldp\") pod \"c0b429bb-956a-4adb-aa22-ba581a9b9245\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " Jul 01 19:19:48.778019 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.777914 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") pod \"c0b429bb-956a-4adb-aa22-ba581a9b9245\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " Jul 01 19:19:48.778019 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.777943 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0b429bb-956a-4adb-aa22-ba581a9b9245-ca-trust-extracted\") pod \"c0b429bb-956a-4adb-aa22-ba581a9b9245\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " Jul 01 19:19:48.778019 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.777972 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-certificates\") pod \"c0b429bb-956a-4adb-aa22-ba581a9b9245\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " Jul 01 19:19:48.778763 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.778341 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c0b429bb-956a-4adb-aa22-ba581a9b9245" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:19:48.778763 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.778501 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-installation-pull-secrets\") pod \"c0b429bb-956a-4adb-aa22-ba581a9b9245\" (UID: \"c0b429bb-956a-4adb-aa22-ba581a9b9245\") " Jul 01 19:19:48.778763 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.778718 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-certificates\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:19:48.780499 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.779195 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c0b429bb-956a-4adb-aa22-ba581a9b9245" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:19:48.781086 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.781057 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c0b429bb-956a-4adb-aa22-ba581a9b9245" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:19:48.781188 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.781127 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c0b429bb-956a-4adb-aa22-ba581a9b9245" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:19:48.781403 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.781357 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c0b429bb-956a-4adb-aa22-ba581a9b9245" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:19:48.781485 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.781441 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c0b429bb-956a-4adb-aa22-ba581a9b9245" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:19:48.781522 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.781488 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-kube-api-access-6vldp" (OuterVolumeSpecName: "kube-api-access-6vldp") pod "c0b429bb-956a-4adb-aa22-ba581a9b9245" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245"). InnerVolumeSpecName "kube-api-access-6vldp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:19:48.787368 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.787339 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b429bb-956a-4adb-aa22-ba581a9b9245-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c0b429bb-956a-4adb-aa22-ba581a9b9245" (UID: "c0b429bb-956a-4adb-aa22-ba581a9b9245"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:19:48.879917 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.879876 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-registry-tls\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:19:48.879917 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.879909 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0b429bb-956a-4adb-aa22-ba581a9b9245-ca-trust-extracted\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:19:48.879917 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.879919 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-installation-pull-secrets\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:19:48.879917 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.879930 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0b429bb-956a-4adb-aa22-ba581a9b9245-trusted-ca\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:19:48.880172 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.879940 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0b429bb-956a-4adb-aa22-ba581a9b9245-image-registry-private-configuration\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:19:48.880172 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.879977 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-bound-sa-token\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:19:48.880172 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:48.879986 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vldp\" (UniqueName: \"kubernetes.io/projected/c0b429bb-956a-4adb-aa22-ba581a9b9245-kube-api-access-6vldp\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:19:49.357657 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.357624 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc"] Jul 01 19:19:49.357873 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.357860 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b429bb-956a-4adb-aa22-ba581a9b9245" containerName="registry" Jul 01 19:19:49.357917 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.357874 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b429bb-956a-4adb-aa22-ba581a9b9245" containerName="registry" Jul 01 19:19:49.357917 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.357915 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b429bb-956a-4adb-aa22-ba581a9b9245" containerName="registry" Jul 01 19:19:49.363361 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.363334 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.365908 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.365873 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 19:19:49.365908 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.365874 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4d4vn\"" Jul 01 19:19:49.366639 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.366620 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:19:49.366785 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.366654 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:19:49.366785 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.366655 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:19:49.366785 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.366715 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:19:49.373245 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.373220 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc"] Jul 01 19:19:49.386161 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.386127 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f28hn"] Jul 01 19:19:49.389584 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.389560 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.393033 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.393010 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:19:49.399229 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.399207 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pkv94\"" Jul 01 19:19:49.400236 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.400218 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:19:49.403702 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.403666 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:19:49.484337 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484302 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-root\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.484337 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484337 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.484573 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484362 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-sys\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.484573 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484380 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36047195-c020-4b44-9e87-1eb8c0ff3f94-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.484573 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484452 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36047195-c020-4b44-9e87-1eb8c0ff3f94-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.484573 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484481 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36047195-c020-4b44-9e87-1eb8c0ff3f94-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.484573 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484506 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-textfile\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.484573 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484531 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-wtmp\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.484573 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484575 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-tls\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.484832 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484593 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.484832 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484608 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-metrics-client-ca\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.484832 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484647 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh5qh\" (UniqueName: \"kubernetes.io/projected/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-kube-api-access-qh5qh\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.484832 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.484664 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjf6c\" (UniqueName: \"kubernetes.io/projected/36047195-c020-4b44-9e87-1eb8c0ff3f94-kube-api-access-rjf6c\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.585594 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585516 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-wtmp\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585594 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585553 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-tls\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585594 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585571 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585594 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585586 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-metrics-client-ca\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585607 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5qh\" (UniqueName: \"kubernetes.io/projected/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-kube-api-access-qh5qh\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585624 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjf6c\" (UniqueName: \"kubernetes.io/projected/36047195-c020-4b44-9e87-1eb8c0ff3f94-kube-api-access-rjf6c\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585644 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-root\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585677 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-wtmp\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585682 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-root\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585784 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585812 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-sys\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585839 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36047195-c020-4b44-9e87-1eb8c0ff3f94-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:49.585868 2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585882 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36047195-c020-4b44-9e87-1eb8c0ff3f94-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585889 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-sys\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.585943 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.585907 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36047195-c020-4b44-9e87-1eb8c0ff3f94-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.586445 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:49.585967 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-tls podName:e254d457-8714-4bd9-b25b-7d39e1d7dbe8 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:50.085944796 +0000 UTC m=+89.266276343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-tls") pod "node-exporter-f28hn" (UID: "e254d457-8714-4bd9-b25b-7d39e1d7dbe8") : secret "node-exporter-tls" not found Jul 01 19:19:49.586445 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:49.586028 2551 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 01 19:19:49.586445 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:19:49.586084 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36047195-c020-4b44-9e87-1eb8c0ff3f94-openshift-state-metrics-tls podName:36047195-c020-4b44-9e87-1eb8c0ff3f94 nodeName:}" failed. No retries permitted until 2026-07-01 19:19:50.086065768 +0000 UTC m=+89.266397315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/36047195-c020-4b44-9e87-1eb8c0ff3f94-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-sc4pc" (UID: "36047195-c020-4b44-9e87-1eb8c0ff3f94") : secret "openshift-state-metrics-tls" not found Jul 01 19:19:49.586445 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.586117 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-textfile\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.586445 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.586283 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-metrics-client-ca\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.586445 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.586392 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.586445 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.586393 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-textfile\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.586669 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.586623 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36047195-c020-4b44-9e87-1eb8c0ff3f94-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.588212 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.588192 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.588276 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.588262 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36047195-c020-4b44-9e87-1eb8c0ff3f94-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.594414 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.594384 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh5qh\" (UniqueName: \"kubernetes.io/projected/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-kube-api-access-qh5qh\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:49.594508 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.594413 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjf6c\" (UniqueName: \"kubernetes.io/projected/36047195-c020-4b44-9e87-1eb8c0ff3f94-kube-api-access-rjf6c\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:49.625101 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.625073 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579f95945d-mht5z" Jul 01 19:19:49.640418 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.640388 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-579f95945d-mht5z"] Jul 01 19:19:49.648998 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:49.648967 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-579f95945d-mht5z"] Jul 01 19:19:50.006972 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.006938 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:50.090921 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.090886 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36047195-c020-4b44-9e87-1eb8c0ff3f94-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:50.091061 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.090938 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-tls\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:50.093315 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.093291 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e254d457-8714-4bd9-b25b-7d39e1d7dbe8-node-exporter-tls\") pod \"node-exporter-f28hn\" (UID: \"e254d457-8714-4bd9-b25b-7d39e1d7dbe8\") " pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:50.093443 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.093348 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36047195-c020-4b44-9e87-1eb8c0ff3f94-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-sc4pc\" (UID: \"36047195-c020-4b44-9e87-1eb8c0ff3f94\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:50.106575 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.106540 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:50.273598 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.273495 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" Jul 01 19:19:50.298966 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.298942 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f28hn" Jul 01 19:19:50.311336 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:50.311308 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode254d457_8714_4bd9_b25b_7d39e1d7dbe8.slice/crio-720a9d11ac0aecd88a75de8d543ceee414f4d184eddb8ee1108ca9f83aae0e35 WatchSource:0}: Error finding container 720a9d11ac0aecd88a75de8d543ceee414f4d184eddb8ee1108ca9f83aae0e35: Status 404 returned error can't find the container with id 720a9d11ac0aecd88a75de8d543ceee414f4d184eddb8ee1108ca9f83aae0e35 Jul 01 19:19:50.322953 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.322928 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:50.424968 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.424932 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:50.425402 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.425064 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc"] Jul 01 19:19:50.428592 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:19:50.428566 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36047195_c020_4b44_9e87_1eb8c0ff3f94.slice/crio-c65b0af3e3533676cdd799a78c2547cb17070f94556ae8d9dc55e5e5b16290bb WatchSource:0}: Error finding container c65b0af3e3533676cdd799a78c2547cb17070f94556ae8d9dc55e5e5b16290bb: Status 404 returned error can't find the container with id c65b0af3e3533676cdd799a78c2547cb17070f94556ae8d9dc55e5e5b16290bb Jul 01 19:19:50.495154 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.495123 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:50.568497 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.568458 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:50.629080 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.629041 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f28hn" event={"ID":"e254d457-8714-4bd9-b25b-7d39e1d7dbe8","Type":"ContainerStarted","Data":"720a9d11ac0aecd88a75de8d543ceee414f4d184eddb8ee1108ca9f83aae0e35"} Jul 01 19:19:50.630750 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.630717 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" event={"ID":"36047195-c020-4b44-9e87-1eb8c0ff3f94","Type":"ContainerStarted","Data":"bd9035ca4448eec0c8239268c96a8534a66f6756bbb94273ac6b07c8446708dc"} Jul 01 19:19:50.630888 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.630771 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" event={"ID":"36047195-c020-4b44-9e87-1eb8c0ff3f94","Type":"ContainerStarted","Data":"9e5f64a50f309de02e6246f18ea63226ef1eff0a9593c7982b9f99e496796e5e"} Jul 01 19:19:50.630888 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.630792 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" event={"ID":"36047195-c020-4b44-9e87-1eb8c0ff3f94","Type":"ContainerStarted","Data":"c65b0af3e3533676cdd799a78c2547cb17070f94556ae8d9dc55e5e5b16290bb"} Jul 01 19:19:50.722557 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:50.722522 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:51.255942 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:51.255909 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0b429bb-956a-4adb-aa22-ba581a9b9245" path="/var/lib/kubelet/pods/c0b429bb-956a-4adb-aa22-ba581a9b9245/volumes" Jul 01 19:19:51.635952 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:51.635915 2551 generic.go:356] "Generic (PLEG): container finished" podID="e254d457-8714-4bd9-b25b-7d39e1d7dbe8" containerID="00fdd1513287edb16ea374eb41eeb2fdc6b112b5c97e579ce0e9d28998f16bd9" exitCode=0 Jul 01 19:19:51.636333 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:51.636009 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f28hn" event={"ID":"e254d457-8714-4bd9-b25b-7d39e1d7dbe8","Type":"ContainerDied","Data":"00fdd1513287edb16ea374eb41eeb2fdc6b112b5c97e579ce0e9d28998f16bd9"} Jul 01 19:19:51.750078 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:51.750054 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:51.843799 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:51.843714 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:52.341518 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:52.341474 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:52.442531 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:52.442494 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:52.607907 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:52.607873 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:52.642095 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:52.642063 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f28hn" event={"ID":"e254d457-8714-4bd9-b25b-7d39e1d7dbe8","Type":"ContainerStarted","Data":"0b3de91b9466f00cfb47d84b3a48a308fbf832215f7690a9aee3dbd6f0b2f5a5"} Jul 01 19:19:52.642509 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:52.642154 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f28hn" event={"ID":"e254d457-8714-4bd9-b25b-7d39e1d7dbe8","Type":"ContainerStarted","Data":"fdf300e40ca6a5fbd5c4d3c14f907f7e146f4712bfc371f7d592239806b2df1a"} Jul 01 19:19:53.254484 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:53.254400 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:53.648817 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:53.648773 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" event={"ID":"36047195-c020-4b44-9e87-1eb8c0ff3f94","Type":"ContainerStarted","Data":"881f0e79e678854e3b9abdf7799994442c81478a923cb8077e1cdfa0cf227eb5"} Jul 01 19:19:53.678614 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:53.678561 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f28hn" podStartSLOduration=3.548315258 podStartE2EDuration="4.678543793s" totalImagesPullingTime="1.058796908s" totalInitContainerRuntime="71.431627ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:52.661529319 +0000 UTC m=+91.841860915" watchObservedRunningTime="2026-07-01 19:19:53.678543793 +0000 UTC m=+92.858875334" Jul 01 19:19:53.678926 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:53.678900 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-sc4pc" podStartSLOduration=2.350957398 podStartE2EDuration="4.678892818s" totalImagesPullingTime="2.32793542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:19:53.678075123 +0000 UTC m=+92.858406712" watchObservedRunningTime="2026-07-01 19:19:53.678892818 +0000 UTC m=+92.859224382" Jul 01 19:19:54.204362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:54.204320 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:54.337768 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:54.337736 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:54.493034 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:54.492946 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:54.590515 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:54.590482 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:19:55.738356 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:19:55.738325 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:05.080588 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:05.080548 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:05.179068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:05.179035 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:05.245241 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:05.245207 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:05.572484 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:05.572456 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rbkmp" Jul 01 19:20:05.857182 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:05.857100 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:05.921496 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:05.921459 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:09.734453 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:09.734421 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v7p9d_06bda432-14d9-475e-9cbe-775b5a4e8722/serve-healthcheck-canary/0.log" Jul 01 19:20:13.930723 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:13.930658 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:14.032242 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:14.032205 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:14.194442 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:14.194344 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:15.778438 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:15.778401 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:15.838042 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:15.838009 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:20:35.792670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:35.792629 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" event={"ID":"a61d63d8-9c4e-41c9-a0d4-01273d7583ae","Type":"ContainerStarted","Data":"58b702c82c07187e18fafe4639935143b2f3d02291dcc81392d6621461544820"} Jul 01 19:20:35.792670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:35.792679 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" event={"ID":"a61d63d8-9c4e-41c9-a0d4-01273d7583ae","Type":"ContainerStarted","Data":"78501b5ebde74157f931ab3b7a4e06a458d4975765e5c31415d05eb7b3830064"} Jul 01 19:20:35.793097 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:35.792708 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" event={"ID":"a61d63d8-9c4e-41c9-a0d4-01273d7583ae","Type":"ContainerStarted","Data":"00131e529bc4863a1da05d3a5bf3657e0307bf50adbd9bc732963acdee35e7d7"} Jul 01 19:20:35.812414 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:20:35.812358 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f98746488-k8jkn" podStartSLOduration=1.063807904 podStartE2EDuration="1m12.812341657s" totalImagesPullingTime="1m11.748533753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:20:35.811992642 +0000 UTC m=+134.992324206" watchObservedRunningTime="2026-07-01 19:20:35.812341657 +0000 UTC m=+134.992673269" Jul 01 19:21:08.765735 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:08.765678 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:10.091302 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:10.091257 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:18.250820 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:18.250777 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:24.023603 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:24.023561 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:24.120436 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:24.120398 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:25.077264 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:25.077233 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:35.891040 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:35.890993 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:35.989640 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:35.989605 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:37.522252 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:37.522206 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:37.619919 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:37.619884 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:39.847227 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:39.847186 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:39.904657 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:39.904624 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:42.400679 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:42.400638 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:50.882220 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:50.882181 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:21:50.980177 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:21:50.980141 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:14.535326 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:14.535289 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:14.629339 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:14.629303 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:15.563068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.563033 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r"] Jul 01 19:22:15.565192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.565175 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.568129 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.568108 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zkdrx\"" Jul 01 19:22:15.568241 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.568154 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:22:15.568867 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.568850 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:22:15.588736 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.588681 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r"] Jul 01 19:22:15.617797 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.617753 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpjdx\" (UniqueName: \"kubernetes.io/projected/4896a003-2ca1-4b5c-9a20-c393e8e0c633-kube-api-access-qpjdx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.617797 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.617802 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.618001 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.617877 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.718370 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.718334 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.718560 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.718380 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.718560 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.718507 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpjdx\" (UniqueName: \"kubernetes.io/projected/4896a003-2ca1-4b5c-9a20-c393e8e0c633-kube-api-access-qpjdx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.718747 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.718730 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.718823 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.718776 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.733531 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.733508 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpjdx\" (UniqueName: \"kubernetes.io/projected/4896a003-2ca1-4b5c-9a20-c393e8e0c633-kube-api-access-qpjdx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:15.874219 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:15.874186 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:16.003757 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:16.003726 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r"] Jul 01 19:22:16.006947 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:22:16.006921 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4896a003_2ca1_4b5c_9a20_c393e8e0c633.slice/crio-fc2873fa5b1cc23cd6412214a5fa2e917ae9c6ec3591debad19f010a4320bd42 WatchSource:0}: Error finding container fc2873fa5b1cc23cd6412214a5fa2e917ae9c6ec3591debad19f010a4320bd42: Status 404 returned error can't find the container with id fc2873fa5b1cc23cd6412214a5fa2e917ae9c6ec3591debad19f010a4320bd42 Jul 01 19:22:16.118827 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:16.118795 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" event={"ID":"4896a003-2ca1-4b5c-9a20-c393e8e0c633","Type":"ContainerStarted","Data":"fc2873fa5b1cc23cd6412214a5fa2e917ae9c6ec3591debad19f010a4320bd42"} Jul 01 19:22:25.154682 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:25.154642 2551 generic.go:356] "Generic (PLEG): container finished" podID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerID="5d3eeddd491aa6cb6e8a08c1625bd9f320c24e057fb94145084aaa1fc5a5a327" exitCode=0 Jul 01 19:22:25.155085 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:25.154743 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" event={"ID":"4896a003-2ca1-4b5c-9a20-c393e8e0c633","Type":"ContainerDied","Data":"5d3eeddd491aa6cb6e8a08c1625bd9f320c24e057fb94145084aaa1fc5a5a327"} Jul 01 19:22:25.518122 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:25.518016 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:28.172895 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:28.172862 2551 generic.go:356] "Generic (PLEG): container finished" podID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerID="363437d3b26d32f2fbd70be166df604cc98f42e6c24638e10960835ac7499668" exitCode=0 Jul 01 19:22:28.173277 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:28.172907 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" event={"ID":"4896a003-2ca1-4b5c-9a20-c393e8e0c633","Type":"ContainerDied","Data":"363437d3b26d32f2fbd70be166df604cc98f42e6c24638e10960835ac7499668"} Jul 01 19:22:37.207319 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:37.207278 2551 generic.go:356] "Generic (PLEG): container finished" podID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerID="dc7fa779f4a08806998a165e68826f7b451e2732731edab986f7971a9953cc4b" exitCode=0 Jul 01 19:22:37.207757 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:37.207366 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" event={"ID":"4896a003-2ca1-4b5c-9a20-c393e8e0c633","Type":"ContainerDied","Data":"dc7fa779f4a08806998a165e68826f7b451e2732731edab986f7971a9953cc4b"} Jul 01 19:22:38.344522 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.344482 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:38.394639 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.394608 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-util\") pod \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " Jul 01 19:22:38.394845 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.394707 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-bundle\") pod \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " Jul 01 19:22:38.394845 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.394743 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpjdx\" (UniqueName: \"kubernetes.io/projected/4896a003-2ca1-4b5c-9a20-c393e8e0c633-kube-api-access-qpjdx\") pod \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\" (UID: \"4896a003-2ca1-4b5c-9a20-c393e8e0c633\") " Jul 01 19:22:38.395675 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.395619 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-bundle" (OuterVolumeSpecName: "bundle") pod "4896a003-2ca1-4b5c-9a20-c393e8e0c633" (UID: "4896a003-2ca1-4b5c-9a20-c393e8e0c633"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:22:38.397582 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.397552 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4896a003-2ca1-4b5c-9a20-c393e8e0c633-kube-api-access-qpjdx" (OuterVolumeSpecName: "kube-api-access-qpjdx") pod "4896a003-2ca1-4b5c-9a20-c393e8e0c633" (UID: "4896a003-2ca1-4b5c-9a20-c393e8e0c633"). InnerVolumeSpecName "kube-api-access-qpjdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:22:38.402159 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.402132 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-util" (OuterVolumeSpecName: "util") pod "4896a003-2ca1-4b5c-9a20-c393e8e0c633" (UID: "4896a003-2ca1-4b5c-9a20-c393e8e0c633"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:22:38.496212 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.496124 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-bundle\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:22:38.496212 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.496156 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpjdx\" (UniqueName: \"kubernetes.io/projected/4896a003-2ca1-4b5c-9a20-c393e8e0c633-kube-api-access-qpjdx\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:22:38.496212 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:38.496167 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4896a003-2ca1-4b5c-9a20-c393e8e0c633-util\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:22:39.216136 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:39.216103 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" event={"ID":"4896a003-2ca1-4b5c-9a20-c393e8e0c633","Type":"ContainerDied","Data":"fc2873fa5b1cc23cd6412214a5fa2e917ae9c6ec3591debad19f010a4320bd42"} Jul 01 19:22:39.216322 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:39.216147 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc2873fa5b1cc23cd6412214a5fa2e917ae9c6ec3591debad19f010a4320bd42" Jul 01 19:22:39.216322 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:39.216146 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw6r" Jul 01 19:22:41.694641 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:41.694608 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:42.607413 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:42.607379 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:44.210812 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.210769 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9"] Jul 01 19:22:44.211299 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.211100 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerName="pull" Jul 01 19:22:44.211299 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.211118 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerName="pull" Jul 01 19:22:44.211299 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.211153 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerName="util" Jul 01 19:22:44.211299 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.211162 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerName="util" Jul 01 19:22:44.211299 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.211171 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerName="extract" Jul 01 19:22:44.211299 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.211179 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerName="extract" Jul 01 19:22:44.211299 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.211231 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="4896a003-2ca1-4b5c-9a20-c393e8e0c633" containerName="extract" Jul 01 19:22:44.213183 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.213160 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" Jul 01 19:22:44.216216 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.216196 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:22:44.216457 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.216436 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-s6cvt\"" Jul 01 19:22:44.216501 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.216450 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 01 19:22:44.234393 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.234366 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9"] Jul 01 19:22:44.340664 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.340625 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1526715-b1f9-442e-9fa3-f405a82337b2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmkm9\" (UID: \"c1526715-b1f9-442e-9fa3-f405a82337b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" Jul 01 19:22:44.340912 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.340679 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhzs6\" (UniqueName: \"kubernetes.io/projected/c1526715-b1f9-442e-9fa3-f405a82337b2-kube-api-access-bhzs6\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmkm9\" (UID: \"c1526715-b1f9-442e-9fa3-f405a82337b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" Jul 01 19:22:44.441884 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.441852 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1526715-b1f9-442e-9fa3-f405a82337b2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmkm9\" (UID: \"c1526715-b1f9-442e-9fa3-f405a82337b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" Jul 01 19:22:44.442041 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.441914 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhzs6\" (UniqueName: \"kubernetes.io/projected/c1526715-b1f9-442e-9fa3-f405a82337b2-kube-api-access-bhzs6\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmkm9\" (UID: \"c1526715-b1f9-442e-9fa3-f405a82337b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" Jul 01 19:22:44.442239 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.442220 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1526715-b1f9-442e-9fa3-f405a82337b2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmkm9\" (UID: \"c1526715-b1f9-442e-9fa3-f405a82337b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" Jul 01 19:22:44.455068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.455039 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhzs6\" (UniqueName: \"kubernetes.io/projected/c1526715-b1f9-442e-9fa3-f405a82337b2-kube-api-access-bhzs6\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmkm9\" (UID: \"c1526715-b1f9-442e-9fa3-f405a82337b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" Jul 01 19:22:44.522118 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.522032 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" Jul 01 19:22:44.661210 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:44.661185 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9"] Jul 01 19:22:44.663288 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:22:44.663256 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1526715_b1f9_442e_9fa3_f405a82337b2.slice/crio-fa8343151d1b0e09399998d8b04c215b89d9ae66b29a19b7bd19d8c7b34ad0fb WatchSource:0}: Error finding container fa8343151d1b0e09399998d8b04c215b89d9ae66b29a19b7bd19d8c7b34ad0fb: Status 404 returned error can't find the container with id fa8343151d1b0e09399998d8b04c215b89d9ae66b29a19b7bd19d8c7b34ad0fb Jul 01 19:22:45.239662 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:45.239620 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" event={"ID":"c1526715-b1f9-442e-9fa3-f405a82337b2","Type":"ContainerStarted","Data":"fa8343151d1b0e09399998d8b04c215b89d9ae66b29a19b7bd19d8c7b34ad0fb"} Jul 01 19:22:45.949090 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:45.949036 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:46.050504 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:46.050470 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:47.870724 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:47.870671 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:47.988204 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:47.988169 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:48.250954 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:48.250867 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" event={"ID":"c1526715-b1f9-442e-9fa3-f405a82337b2","Type":"ContainerStarted","Data":"1a85fb0cb45e3fecb84648555c7950848b709ec8765181b37d2f5f40e6b86e7a"} Jul 01 19:22:48.278931 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:48.278875 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmkm9" podStartSLOduration=1.735774116 podStartE2EDuration="4.278858341s" totalImagesPullingTime="2.543084225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:48.276102179 +0000 UTC m=+267.456433736" watchObservedRunningTime="2026-07-01 19:22:48.278858341 +0000 UTC m=+267.459189906" Jul 01 19:22:48.702748 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:48.702712 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:48.867506 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:48.867467 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:49.141887 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.141851 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m"] Jul 01 19:22:49.144249 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.144224 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.148662 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.148635 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:22:49.148806 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.148664 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:22:49.153927 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.153883 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zkdrx\"" Jul 01 19:22:49.170926 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.170892 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m"] Jul 01 19:22:49.279167 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.279129 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.279167 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.279173 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.279384 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.279197 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgrkm\" (UniqueName: \"kubernetes.io/projected/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-kube-api-access-pgrkm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.380112 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.380074 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.380283 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.380130 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.380283 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.380154 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgrkm\" (UniqueName: \"kubernetes.io/projected/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-kube-api-access-pgrkm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.380468 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.380447 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.380543 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.380522 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.429063 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.428989 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgrkm\" (UniqueName: \"kubernetes.io/projected/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-kube-api-access-pgrkm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.458451 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.458416 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:49.627120 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:49.627079 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m"] Jul 01 19:22:49.630374 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:22:49.630340 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a2037a_3dd3_4670_80b8_9a57a61d2ac7.slice/crio-6fc06e59fb34c6ac3870446b82764eaf93a3c00782e9a7eb3af3f7eacbd22aa3 WatchSource:0}: Error finding container 6fc06e59fb34c6ac3870446b82764eaf93a3c00782e9a7eb3af3f7eacbd22aa3: Status 404 returned error can't find the container with id 6fc06e59fb34c6ac3870446b82764eaf93a3c00782e9a7eb3af3f7eacbd22aa3 Jul 01 19:22:50.258913 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:50.258876 2551 generic.go:356] "Generic (PLEG): container finished" podID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerID="f4305b360d1c10924cc7504a9ec4eae7769ee6d86d9ec0bf1c8080d9a84e660b" exitCode=0 Jul 01 19:22:50.259298 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:50.258946 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" event={"ID":"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7","Type":"ContainerDied","Data":"f4305b360d1c10924cc7504a9ec4eae7769ee6d86d9ec0bf1c8080d9a84e660b"} Jul 01 19:22:50.259298 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:50.258993 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" event={"ID":"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7","Type":"ContainerStarted","Data":"6fc06e59fb34c6ac3870446b82764eaf93a3c00782e9a7eb3af3f7eacbd22aa3"} Jul 01 19:22:51.374340 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.374302 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:51.725311 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.725236 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb"] Jul 01 19:22:51.727834 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.727815 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" Jul 01 19:22:51.734414 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.734387 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 19:22:51.734851 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.734825 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xlsbb\"" Jul 01 19:22:51.735485 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.735466 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 19:22:51.777303 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.777268 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb"] Jul 01 19:22:51.796316 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.796277 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a899ab0-f688-45f6-88a9-c3da8369a6dd-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-t5vqb\" (UID: \"6a899ab0-f688-45f6-88a9-c3da8369a6dd\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" Jul 01 19:22:51.796316 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.796315 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfz8p\" (UniqueName: \"kubernetes.io/projected/6a899ab0-f688-45f6-88a9-c3da8369a6dd-kube-api-access-sfz8p\") pod \"cert-manager-cainjector-5d99449ffd-t5vqb\" (UID: \"6a899ab0-f688-45f6-88a9-c3da8369a6dd\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" Jul 01 19:22:51.896922 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.896883 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfz8p\" (UniqueName: \"kubernetes.io/projected/6a899ab0-f688-45f6-88a9-c3da8369a6dd-kube-api-access-sfz8p\") pod \"cert-manager-cainjector-5d99449ffd-t5vqb\" (UID: \"6a899ab0-f688-45f6-88a9-c3da8369a6dd\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" Jul 01 19:22:51.897071 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.896974 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a899ab0-f688-45f6-88a9-c3da8369a6dd-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-t5vqb\" (UID: \"6a899ab0-f688-45f6-88a9-c3da8369a6dd\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" Jul 01 19:22:51.909924 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.909890 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfz8p\" (UniqueName: \"kubernetes.io/projected/6a899ab0-f688-45f6-88a9-c3da8369a6dd-kube-api-access-sfz8p\") pod \"cert-manager-cainjector-5d99449ffd-t5vqb\" (UID: \"6a899ab0-f688-45f6-88a9-c3da8369a6dd\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" Jul 01 19:22:51.914638 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.914598 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a899ab0-f688-45f6-88a9-c3da8369a6dd-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-t5vqb\" (UID: \"6a899ab0-f688-45f6-88a9-c3da8369a6dd\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" Jul 01 19:22:51.985635 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:51.985548 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:52.037211 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:52.037176 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" Jul 01 19:22:52.191512 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:52.191481 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb"] Jul 01 19:22:52.194181 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:22:52.194152 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a899ab0_f688_45f6_88a9_c3da8369a6dd.slice/crio-f21e223b8de1423cdbaaa7dcf9cfa3a5ce6c6ac83c1181a490c0f3d2bd4bf22e WatchSource:0}: Error finding container f21e223b8de1423cdbaaa7dcf9cfa3a5ce6c6ac83c1181a490c0f3d2bd4bf22e: Status 404 returned error can't find the container with id f21e223b8de1423cdbaaa7dcf9cfa3a5ce6c6ac83c1181a490c0f3d2bd4bf22e Jul 01 19:22:52.270179 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:52.270098 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" event={"ID":"6a899ab0-f688-45f6-88a9-c3da8369a6dd","Type":"ContainerStarted","Data":"f21e223b8de1423cdbaaa7dcf9cfa3a5ce6c6ac83c1181a490c0f3d2bd4bf22e"} Jul 01 19:22:53.516894 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:53.516851 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:53.676213 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:53.676157 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:22:57.289413 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:57.289376 2551 generic.go:356] "Generic (PLEG): container finished" podID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerID="aac41ecfeafa5cd68be442fb55043dba68e9bc51e597c45d1e67a263af0a4634" exitCode=0 Jul 01 19:22:57.289813 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:57.289460 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" event={"ID":"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7","Type":"ContainerDied","Data":"aac41ecfeafa5cd68be442fb55043dba68e9bc51e597c45d1e67a263af0a4634"} Jul 01 19:22:58.296098 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:58.296060 2551 generic.go:356] "Generic (PLEG): container finished" podID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerID="c69397345b29e29957182ac0be89ff102bfa21f1aeacd785dc36574f083cde89" exitCode=0 Jul 01 19:22:58.296514 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:58.296148 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" event={"ID":"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7","Type":"ContainerDied","Data":"c69397345b29e29957182ac0be89ff102bfa21f1aeacd785dc36574f083cde89"} Jul 01 19:22:59.559380 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.559313 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:22:59.657308 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.657270 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-util\") pod \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " Jul 01 19:22:59.657464 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.657336 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgrkm\" (UniqueName: \"kubernetes.io/projected/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-kube-api-access-pgrkm\") pod \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " Jul 01 19:22:59.657464 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.657362 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-bundle\") pod \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\" (UID: \"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7\") " Jul 01 19:22:59.657855 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.657827 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-bundle" (OuterVolumeSpecName: "bundle") pod "b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" (UID: "b9a2037a-3dd3-4670-80b8-9a57a61d2ac7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:22:59.659597 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.659566 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-kube-api-access-pgrkm" (OuterVolumeSpecName: "kube-api-access-pgrkm") pod "b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" (UID: "b9a2037a-3dd3-4670-80b8-9a57a61d2ac7"). InnerVolumeSpecName "kube-api-access-pgrkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:22:59.661563 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.661538 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-util" (OuterVolumeSpecName: "util") pod "b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" (UID: "b9a2037a-3dd3-4670-80b8-9a57a61d2ac7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:22:59.758818 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.758780 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-bundle\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:22:59.758818 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.758808 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-util\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:22:59.758818 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.758817 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgrkm\" (UniqueName: \"kubernetes.io/projected/b9a2037a-3dd3-4670-80b8-9a57a61d2ac7-kube-api-access-pgrkm\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:22:59.806015 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:22:59.805974 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:00.306584 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:00.306549 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" event={"ID":"b9a2037a-3dd3-4670-80b8-9a57a61d2ac7","Type":"ContainerDied","Data":"6fc06e59fb34c6ac3870446b82764eaf93a3c00782e9a7eb3af3f7eacbd22aa3"} Jul 01 19:23:00.306763 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:00.306603 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fc06e59fb34c6ac3870446b82764eaf93a3c00782e9a7eb3af3f7eacbd22aa3" Jul 01 19:23:00.306763 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:00.306558 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmmb9m" Jul 01 19:23:00.308281 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:00.308250 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" event={"ID":"6a899ab0-f688-45f6-88a9-c3da8369a6dd","Type":"ContainerStarted","Data":"47bf2d42b553a125f0a26a3955aa9aec9dd088ca41db16ceaa4c0ec9c9478a53"} Jul 01 19:23:00.334304 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:00.334241 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5vqb" podStartSLOduration=1.947419428 podStartE2EDuration="9.334223132s" totalImagesPullingTime="7.386803704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:00.333859292 +0000 UTC m=+279.514190856" watchObservedRunningTime="2026-07-01 19:23:00.334223132 +0000 UTC m=+279.514554697" Jul 01 19:23:00.972626 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:00.972590 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:01.113409 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:01.113372 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:05.105839 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:05.105799 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:05.242517 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:05.242478 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:08.565838 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.565805 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-fjfck"] Jul 01 19:23:08.566291 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.566045 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerName="extract" Jul 01 19:23:08.566291 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.566057 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerName="extract" Jul 01 19:23:08.566291 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.566067 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerName="util" Jul 01 19:23:08.566291 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.566072 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerName="util" Jul 01 19:23:08.566291 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.566077 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerName="pull" Jul 01 19:23:08.566291 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.566083 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerName="pull" Jul 01 19:23:08.566291 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.566121 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9a2037a-3dd3-4670-80b8-9a57a61d2ac7" containerName="extract" Jul 01 19:23:08.570568 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.570549 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fjfck" Jul 01 19:23:08.573080 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.573059 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wtbrb\"" Jul 01 19:23:08.582024 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.582001 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fjfck"] Jul 01 19:23:08.724219 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.724181 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70b7564a-b4ef-461a-a5ff-26f0152a5251-bound-sa-token\") pod \"cert-manager-59c77684cc-fjfck\" (UID: \"70b7564a-b4ef-461a-a5ff-26f0152a5251\") " pod="cert-manager/cert-manager-59c77684cc-fjfck" Jul 01 19:23:08.724409 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.724239 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg46s\" (UniqueName: \"kubernetes.io/projected/70b7564a-b4ef-461a-a5ff-26f0152a5251-kube-api-access-kg46s\") pod \"cert-manager-59c77684cc-fjfck\" (UID: \"70b7564a-b4ef-461a-a5ff-26f0152a5251\") " pod="cert-manager/cert-manager-59c77684cc-fjfck" Jul 01 19:23:08.825142 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.825044 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70b7564a-b4ef-461a-a5ff-26f0152a5251-bound-sa-token\") pod \"cert-manager-59c77684cc-fjfck\" (UID: \"70b7564a-b4ef-461a-a5ff-26f0152a5251\") " pod="cert-manager/cert-manager-59c77684cc-fjfck" Jul 01 19:23:08.825142 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.825119 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg46s\" (UniqueName: \"kubernetes.io/projected/70b7564a-b4ef-461a-a5ff-26f0152a5251-kube-api-access-kg46s\") pod \"cert-manager-59c77684cc-fjfck\" (UID: \"70b7564a-b4ef-461a-a5ff-26f0152a5251\") " pod="cert-manager/cert-manager-59c77684cc-fjfck" Jul 01 19:23:08.833597 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.833562 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70b7564a-b4ef-461a-a5ff-26f0152a5251-bound-sa-token\") pod \"cert-manager-59c77684cc-fjfck\" (UID: \"70b7564a-b4ef-461a-a5ff-26f0152a5251\") " pod="cert-manager/cert-manager-59c77684cc-fjfck" Jul 01 19:23:08.834287 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.834267 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg46s\" (UniqueName: \"kubernetes.io/projected/70b7564a-b4ef-461a-a5ff-26f0152a5251-kube-api-access-kg46s\") pod \"cert-manager-59c77684cc-fjfck\" (UID: \"70b7564a-b4ef-461a-a5ff-26f0152a5251\") " pod="cert-manager/cert-manager-59c77684cc-fjfck" Jul 01 19:23:08.879284 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:08.879245 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fjfck" Jul 01 19:23:09.007032 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:09.006998 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fjfck"] Jul 01 19:23:09.009870 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:23:09.009844 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70b7564a_b4ef_461a_a5ff_26f0152a5251.slice/crio-d9f682eba858907d0d272075903ab9720a9f37bfeff48b174eb38cc115cdff83 WatchSource:0}: Error finding container d9f682eba858907d0d272075903ab9720a9f37bfeff48b174eb38cc115cdff83: Status 404 returned error can't find the container with id d9f682eba858907d0d272075903ab9720a9f37bfeff48b174eb38cc115cdff83 Jul 01 19:23:09.340035 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:09.340000 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fjfck" event={"ID":"70b7564a-b4ef-461a-a5ff-26f0152a5251","Type":"ContainerStarted","Data":"a5665b7dbfa112a7c1cc8c8408b23c31fef69db853f8432d3b8708dd2ca8b96b"} Jul 01 19:23:09.340035 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:09.340042 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fjfck" event={"ID":"70b7564a-b4ef-461a-a5ff-26f0152a5251","Type":"ContainerStarted","Data":"d9f682eba858907d0d272075903ab9720a9f37bfeff48b174eb38cc115cdff83"} Jul 01 19:23:09.359010 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:09.358953 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-fjfck" podStartSLOduration=1.358933776 podStartE2EDuration="1.358933776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:09.358393164 +0000 UTC m=+288.538724729" watchObservedRunningTime="2026-07-01 19:23:09.358933776 +0000 UTC m=+288.539265346" Jul 01 19:23:11.114208 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:11.114161 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:11.214285 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:11.214248 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:12.782118 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:12.782080 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:12.937523 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:12.937489 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8"] Jul 01 19:23:12.939522 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:12.939507 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:12.941967 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:12.941949 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:23:12.942819 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:12.942805 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zkdrx\"" Jul 01 19:23:12.942877 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:12.942854 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:23:12.954281 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:12.954250 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8"] Jul 01 19:23:13.057302 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.057206 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.057302 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.057254 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.057302 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.057271 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5klp\" (UniqueName: \"kubernetes.io/projected/cc341865-8b23-4706-a6de-14edc60d1691-kube-api-access-d5klp\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.158295 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.158242 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.158476 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.158310 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.158476 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.158333 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5klp\" (UniqueName: \"kubernetes.io/projected/cc341865-8b23-4706-a6de-14edc60d1691-kube-api-access-d5klp\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.158641 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.158618 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.158683 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.158666 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.168858 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.168828 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5klp\" (UniqueName: \"kubernetes.io/projected/cc341865-8b23-4706-a6de-14edc60d1691-kube-api-access-d5klp\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.248393 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.248354 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:13.373620 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:13.373584 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8"] Jul 01 19:23:13.376924 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:23:13.376886 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc341865_8b23_4706_a6de_14edc60d1691.slice/crio-5bc88f08d8447803559c6ac6fc0b571328b27ba75d3d6172bd9abd91b4384481 WatchSource:0}: Error finding container 5bc88f08d8447803559c6ac6fc0b571328b27ba75d3d6172bd9abd91b4384481: Status 404 returned error can't find the container with id 5bc88f08d8447803559c6ac6fc0b571328b27ba75d3d6172bd9abd91b4384481 Jul 01 19:23:14.365284 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:14.365251 2551 generic.go:356] "Generic (PLEG): container finished" podID="cc341865-8b23-4706-a6de-14edc60d1691" containerID="3a2e9665f15d41f8479772d959f2c8619e1b35c0da2e422dcc8bc15da25a3132" exitCode=0 Jul 01 19:23:14.365759 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:14.365313 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" event={"ID":"cc341865-8b23-4706-a6de-14edc60d1691","Type":"ContainerDied","Data":"3a2e9665f15d41f8479772d959f2c8619e1b35c0da2e422dcc8bc15da25a3132"} Jul 01 19:23:14.365759 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:14.365351 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" event={"ID":"cc341865-8b23-4706-a6de-14edc60d1691","Type":"ContainerStarted","Data":"5bc88f08d8447803559c6ac6fc0b571328b27ba75d3d6172bd9abd91b4384481"} Jul 01 19:23:15.371074 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:15.371040 2551 generic.go:356] "Generic (PLEG): container finished" podID="cc341865-8b23-4706-a6de-14edc60d1691" containerID="75c1ec3a5fed37a6da02beaf65d86a203937de9c479261df07ff91a3552a3dfa" exitCode=0 Jul 01 19:23:15.371477 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:15.371111 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" event={"ID":"cc341865-8b23-4706-a6de-14edc60d1691","Type":"ContainerDied","Data":"75c1ec3a5fed37a6da02beaf65d86a203937de9c479261df07ff91a3552a3dfa"} Jul 01 19:23:16.377343 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:16.377304 2551 generic.go:356] "Generic (PLEG): container finished" podID="cc341865-8b23-4706-a6de-14edc60d1691" containerID="5a05b5fe062101323c10cc64cfbfc260e6575c25ce0e00a5783e7752067fe382" exitCode=0 Jul 01 19:23:16.377757 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:16.377390 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" event={"ID":"cc341865-8b23-4706-a6de-14edc60d1691","Type":"ContainerDied","Data":"5a05b5fe062101323c10cc64cfbfc260e6575c25ce0e00a5783e7752067fe382"} Jul 01 19:23:17.518915 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.518890 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:17.694259 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.694163 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-bundle\") pod \"cc341865-8b23-4706-a6de-14edc60d1691\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " Jul 01 19:23:17.694259 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.694225 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5klp\" (UniqueName: \"kubernetes.io/projected/cc341865-8b23-4706-a6de-14edc60d1691-kube-api-access-d5klp\") pod \"cc341865-8b23-4706-a6de-14edc60d1691\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " Jul 01 19:23:17.694472 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.694261 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-util\") pod \"cc341865-8b23-4706-a6de-14edc60d1691\" (UID: \"cc341865-8b23-4706-a6de-14edc60d1691\") " Jul 01 19:23:17.694992 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.694960 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-bundle" (OuterVolumeSpecName: "bundle") pod "cc341865-8b23-4706-a6de-14edc60d1691" (UID: "cc341865-8b23-4706-a6de-14edc60d1691"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:23:17.696357 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.696329 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc341865-8b23-4706-a6de-14edc60d1691-kube-api-access-d5klp" (OuterVolumeSpecName: "kube-api-access-d5klp") pod "cc341865-8b23-4706-a6de-14edc60d1691" (UID: "cc341865-8b23-4706-a6de-14edc60d1691"). InnerVolumeSpecName "kube-api-access-d5klp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:23:17.699759 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.699733 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-util" (OuterVolumeSpecName: "util") pod "cc341865-8b23-4706-a6de-14edc60d1691" (UID: "cc341865-8b23-4706-a6de-14edc60d1691"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:23:17.794816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.794779 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-bundle\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:23:17.794816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.794811 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5klp\" (UniqueName: \"kubernetes.io/projected/cc341865-8b23-4706-a6de-14edc60d1691-kube-api-access-d5klp\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:23:17.794816 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:17.794822 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc341865-8b23-4706-a6de-14edc60d1691-util\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:23:18.386892 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:18.386858 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" Jul 01 19:23:18.386892 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:18.386874 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnl5j8" event={"ID":"cc341865-8b23-4706-a6de-14edc60d1691","Type":"ContainerDied","Data":"5bc88f08d8447803559c6ac6fc0b571328b27ba75d3d6172bd9abd91b4384481"} Jul 01 19:23:18.387093 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:18.386915 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bc88f08d8447803559c6ac6fc0b571328b27ba75d3d6172bd9abd91b4384481" Jul 01 19:23:21.204566 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:21.204537 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:23:21.205940 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:21.205911 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:23:21.208394 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:21.208372 2551 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:23:29.053143 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:29.053107 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:30.108528 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.108496 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl"] Jul 01 19:23:30.108981 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.108774 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc341865-8b23-4706-a6de-14edc60d1691" containerName="pull" Jul 01 19:23:30.108981 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.108786 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc341865-8b23-4706-a6de-14edc60d1691" containerName="pull" Jul 01 19:23:30.108981 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.108797 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc341865-8b23-4706-a6de-14edc60d1691" containerName="util" Jul 01 19:23:30.108981 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.108803 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc341865-8b23-4706-a6de-14edc60d1691" containerName="util" Jul 01 19:23:30.108981 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.108809 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc341865-8b23-4706-a6de-14edc60d1691" containerName="extract" Jul 01 19:23:30.108981 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.108815 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc341865-8b23-4706-a6de-14edc60d1691" containerName="extract" Jul 01 19:23:30.108981 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.108859 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc341865-8b23-4706-a6de-14edc60d1691" containerName="extract" Jul 01 19:23:30.110756 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.110733 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.113322 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.113300 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 19:23:30.113523 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.113503 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cbmqr\"" Jul 01 19:23:30.113976 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.113959 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 19:23:30.114036 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.113968 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 19:23:30.114227 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.114211 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 19:23:30.147566 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.147533 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl"] Jul 01 19:23:30.179531 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.179502 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.179735 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.179553 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-tmp\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.179735 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.179631 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-manifests\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.179735 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.179663 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69ktn\" (UniqueName: \"kubernetes.io/projected/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-kube-api-access-69ktn\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.179859 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.179739 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.280719 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.280655 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.280719 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.280731 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.280980 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.280756 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-tmp\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.280980 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.280791 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-manifests\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.280980 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.280810 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69ktn\" (UniqueName: \"kubernetes.io/projected/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-kube-api-access-69ktn\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.281257 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.281235 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-manifests\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.283194 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.283175 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.283453 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.283433 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-tmp\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.283552 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.283536 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.292899 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.292870 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69ktn\" (UniqueName: \"kubernetes.io/projected/b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea-kube-api-access-69ktn\") pod \"opendatahub-operator-controller-manager-7744974bcd-bdptl\" (UID: \"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea\") " pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.421698 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.421587 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:30.573443 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.573402 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl"] Jul 01 19:23:30.579549 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:23:30.579515 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d41c5e_6e73_4a06_9d36_c5e3eeb333ea.slice/crio-2de886ff64fa4a91bdbbe6897e8a4cbebe36c5ef3853f44489421c60f4962dbd WatchSource:0}: Error finding container 2de886ff64fa4a91bdbbe6897e8a4cbebe36c5ef3853f44489421c60f4962dbd: Status 404 returned error can't find the container with id 2de886ff64fa4a91bdbbe6897e8a4cbebe36c5ef3853f44489421c60f4962dbd Jul 01 19:23:30.582050 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.582031 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:23:30.853992 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.853890 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:30.948065 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:30.948031 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:31.443455 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:31.443419 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" event={"ID":"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea","Type":"ContainerStarted","Data":"2de886ff64fa4a91bdbbe6897e8a4cbebe36c5ef3853f44489421c60f4962dbd"} Jul 01 19:23:34.460021 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:34.459987 2551 generic.go:356] "Generic (PLEG): container finished" podID="b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea" containerID="1d0c6e29c2924d4c6e3b69e1bc18df201f359e1938e0f38beee13d10714307ad" exitCode=0 Jul 01 19:23:34.460394 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:34.460064 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" event={"ID":"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea","Type":"ContainerDied","Data":"1d0c6e29c2924d4c6e3b69e1bc18df201f359e1938e0f38beee13d10714307ad"} Jul 01 19:23:35.141449 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:35.141406 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:35.270641 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:35.270608 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:35.466542 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:35.466436 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" event={"ID":"b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea","Type":"ContainerStarted","Data":"68d37781c3b109ede70b1bfac1f1111c9d9a687c469bb8a739be42a34a64cdce"} Jul 01 19:23:35.466542 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:35.466507 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:35.496999 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:35.496931 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" podStartSLOduration=1.3516401359999999 podStartE2EDuration="5.496915165s" totalImagesPullingTime="3.217724221s" totalInitContainerRuntime="927.550808ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:35.495985197 +0000 UTC m=+314.676317009" watchObservedRunningTime="2026-07-01 19:23:35.496915165 +0000 UTC m=+314.677246729" Jul 01 19:23:46.475318 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:46.475289 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7744974bcd-bdptl" Jul 01 19:23:48.507145 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:48.507110 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:48.643302 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:48.643256 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:49.090940 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.090908 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:49.259681 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.259643 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs"] Jul 01 19:23:49.264155 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.264130 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.285433 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.285404 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 19:23:49.285433 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.285426 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 19:23:49.285668 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.285532 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 19:23:49.286318 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.286301 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 19:23:49.286372 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.286328 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xhg5g\"" Jul 01 19:23:49.301144 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.301109 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37ab2364-87b4-4e96-8a98-fb7d22201597-tls-certs\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.301144 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.301148 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37ab2364-87b4-4e96-8a98-fb7d22201597-tmp\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.301357 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.301211 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh4wm\" (UniqueName: \"kubernetes.io/projected/37ab2364-87b4-4e96-8a98-fb7d22201597-kube-api-access-zh4wm\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.329080 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.329044 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs"] Jul 01 19:23:49.402195 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.402153 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh4wm\" (UniqueName: \"kubernetes.io/projected/37ab2364-87b4-4e96-8a98-fb7d22201597-kube-api-access-zh4wm\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.402407 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.402203 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37ab2364-87b4-4e96-8a98-fb7d22201597-tls-certs\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.402407 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.402229 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37ab2364-87b4-4e96-8a98-fb7d22201597-tmp\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.402407 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:23:49.402312 2551 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 01 19:23:49.402407 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:23:49.402390 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ab2364-87b4-4e96-8a98-fb7d22201597-tls-certs podName:37ab2364-87b4-4e96-8a98-fb7d22201597 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:49.902373297 +0000 UTC m=+329.082704843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/37ab2364-87b4-4e96-8a98-fb7d22201597-tls-certs") pod "kube-auth-proxy-7994ff9b78-w6fxs" (UID: "37ab2364-87b4-4e96-8a98-fb7d22201597") : secret "kube-auth-proxy-tls" not found Jul 01 19:23:49.404490 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.404473 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37ab2364-87b4-4e96-8a98-fb7d22201597-tmp\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.457950 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.457912 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh4wm\" (UniqueName: \"kubernetes.io/projected/37ab2364-87b4-4e96-8a98-fb7d22201597-kube-api-access-zh4wm\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.639130 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.639087 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:49.739101 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.738981 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:49.845830 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.845792 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:49.906097 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.906055 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37ab2364-87b4-4e96-8a98-fb7d22201597-tls-certs\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.908576 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.908548 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37ab2364-87b4-4e96-8a98-fb7d22201597-tls-certs\") pod \"kube-auth-proxy-7994ff9b78-w6fxs\" (UID: \"37ab2364-87b4-4e96-8a98-fb7d22201597\") " pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:49.940362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:49.940318 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:50.174377 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:50.174343 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" Jul 01 19:23:50.328129 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:50.328104 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs"] Jul 01 19:23:50.331170 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:23:50.331143 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ab2364_87b4_4e96_8a98_fb7d22201597.slice/crio-1929b983bbb3ab186cbe51f2108f5d1e99414723658af49593268535301041d7 WatchSource:0}: Error finding container 1929b983bbb3ab186cbe51f2108f5d1e99414723658af49593268535301041d7: Status 404 returned error can't find the container with id 1929b983bbb3ab186cbe51f2108f5d1e99414723658af49593268535301041d7 Jul 01 19:23:50.532590 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:50.532494 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" event={"ID":"37ab2364-87b4-4e96-8a98-fb7d22201597","Type":"ContainerStarted","Data":"1929b983bbb3ab186cbe51f2108f5d1e99414723658af49593268535301041d7"} Jul 01 19:23:50.555902 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:50.555860 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:50.829144 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:50.829036 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:50.928802 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:50.928762 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:51.401133 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:51.401084 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:52.068609 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:52.068570 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:53.550000 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:53.549900 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" event={"ID":"37ab2364-87b4-4e96-8a98-fb7d22201597","Type":"ContainerStarted","Data":"6cb4537beadef27795d8e7271df65df8b964e38cb7c6877d5ffd48bf490f8700"} Jul 01 19:23:53.571746 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:53.571655 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7994ff9b78-w6fxs" podStartSLOduration=1.7459651059999999 podStartE2EDuration="4.571633445s" totalImagesPullingTime="2.825668339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:53.569464873 +0000 UTC m=+332.749796461" watchObservedRunningTime="2026-07-01 19:23:53.571633445 +0000 UTC m=+332.751965010" Jul 01 19:23:57.383957 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.383922 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4"] Jul 01 19:23:57.387166 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.387147 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.392185 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.392158 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 19:23:57.392438 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.392421 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 19:23:57.392524 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.392425 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 19:23:57.392586 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.392533 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fn47x\"" Jul 01 19:23:57.393583 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.393562 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 19:23:57.414500 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.414465 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4"] Jul 01 19:23:57.466639 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.466600 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.466855 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.466642 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.466855 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.466675 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.466855 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.466743 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llhn4\" (UniqueName: \"kubernetes.io/projected/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-kube-api-access-llhn4\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.466855 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.466807 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.467035 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.466855 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.467035 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.466896 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.530366 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.530331 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:57.567658 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.567620 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.567881 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.567672 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.567881 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.567701 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.567881 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.567742 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.567881 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.567775 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhn4\" (UniqueName: \"kubernetes.io/projected/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-kube-api-access-llhn4\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.567881 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.567831 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.568147 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.568017 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.568567 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.568544 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.570294 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.570252 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.570294 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.570254 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.570481 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.570461 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.570530 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.570512 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.579957 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.579917 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.581742 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.581720 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llhn4\" (UniqueName: \"kubernetes.io/projected/e2084be1-ddbf-45dc-a13a-0d18a809ca3f-kube-api-access-llhn4\") pod \"istiod-openshift-gateway-94bb8fbfd-f6pc4\" (UID: \"e2084be1-ddbf-45dc-a13a-0d18a809ca3f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.639563 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.639444 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:57.697663 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.697623 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:23:57.875260 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:23:57.875230 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2084be1_ddbf_45dc_a13a_0d18a809ca3f.slice/crio-527f96d0f731b674e476de9da038f77c8ba4237b26cf4f2e01f8996fb8974f8f WatchSource:0}: Error finding container 527f96d0f731b674e476de9da038f77c8ba4237b26cf4f2e01f8996fb8974f8f: Status 404 returned error can't find the container with id 527f96d0f731b674e476de9da038f77c8ba4237b26cf4f2e01f8996fb8974f8f Jul 01 19:23:57.879071 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.879047 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4"] Jul 01 19:23:57.920890 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:57.920785 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:58.058757 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:58.058715 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:58.242320 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:58.242221 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:58.573178 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:23:58.573089 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" event={"ID":"e2084be1-ddbf-45dc-a13a-0d18a809ca3f","Type":"ContainerStarted","Data":"527f96d0f731b674e476de9da038f77c8ba4237b26cf4f2e01f8996fb8974f8f"} Jul 01 19:24:00.405668 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:00.405624 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 01 19:24:00.405976 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:00.405709 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 01 19:24:00.584522 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:00.584485 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" event={"ID":"e2084be1-ddbf-45dc-a13a-0d18a809ca3f","Type":"ContainerStarted","Data":"1b5eada72cadf10c0311c333bbcaf5739cf3bd9e19dfa28e1208742e827a5a9e"} Jul 01 19:24:00.584737 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:00.584622 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:24:00.708815 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:00.708666 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" podStartSLOduration=1.180620048 podStartE2EDuration="3.708650028s" totalImagesPullingTime="2.52802998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:00.708636526 +0000 UTC m=+339.888968090" watchObservedRunningTime="2026-07-01 19:24:00.708650028 +0000 UTC m=+339.888981591" Jul 01 19:24:00.859983 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:00.859946 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:01.089033 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:01.088934 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:01.331468 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:01.331439 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:01.489340 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:01.489306 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:01.590469 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:01.590443 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-f6pc4" Jul 01 19:24:02.366000 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:02.365951 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:02.481321 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:02.481286 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:04.287064 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.287029 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-59994cc79f-f5zsd"] Jul 01 19:24:04.353405 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.353365 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:04.358596 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.358570 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-59994cc79f-f5zsd"] Jul 01 19:24:04.358746 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.358684 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" Jul 01 19:24:04.363203 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.363179 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lk49n\"" Jul 01 19:24:04.363432 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.363413 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 19:24:04.426013 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.425977 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4s7p\" (UniqueName: \"kubernetes.io/projected/3fc460b5-4602-4e81-9e85-d1fecb112d2c-kube-api-access-n4s7p\") pod \"dashboard-redirect-59994cc79f-f5zsd\" (UID: \"3fc460b5-4602-4e81-9e85-d1fecb112d2c\") " pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" Jul 01 19:24:04.426170 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.426074 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3fc460b5-4602-4e81-9e85-d1fecb112d2c-redirect-config\") pod \"dashboard-redirect-59994cc79f-f5zsd\" (UID: \"3fc460b5-4602-4e81-9e85-d1fecb112d2c\") " pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" Jul 01 19:24:04.526595 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.526549 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3fc460b5-4602-4e81-9e85-d1fecb112d2c-redirect-config\") pod \"dashboard-redirect-59994cc79f-f5zsd\" (UID: \"3fc460b5-4602-4e81-9e85-d1fecb112d2c\") " pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" Jul 01 19:24:04.526801 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.526610 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4s7p\" (UniqueName: \"kubernetes.io/projected/3fc460b5-4602-4e81-9e85-d1fecb112d2c-kube-api-access-n4s7p\") pod \"dashboard-redirect-59994cc79f-f5zsd\" (UID: \"3fc460b5-4602-4e81-9e85-d1fecb112d2c\") " pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" Jul 01 19:24:04.527264 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.527242 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3fc460b5-4602-4e81-9e85-d1fecb112d2c-redirect-config\") pod \"dashboard-redirect-59994cc79f-f5zsd\" (UID: \"3fc460b5-4602-4e81-9e85-d1fecb112d2c\") " pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" Jul 01 19:24:04.535342 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.535317 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4s7p\" (UniqueName: \"kubernetes.io/projected/3fc460b5-4602-4e81-9e85-d1fecb112d2c-kube-api-access-n4s7p\") pod \"dashboard-redirect-59994cc79f-f5zsd\" (UID: \"3fc460b5-4602-4e81-9e85-d1fecb112d2c\") " pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" Jul 01 19:24:04.669271 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.669235 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" Jul 01 19:24:04.813454 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:04.813426 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-59994cc79f-f5zsd"] Jul 01 19:24:04.815681 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:24:04.815651 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc460b5_4602_4e81_9e85_d1fecb112d2c.slice/crio-c71d6276d0511c221ebfbeeb89ca60cb7da5d87aa24f964516b4b34d78332237 WatchSource:0}: Error finding container c71d6276d0511c221ebfbeeb89ca60cb7da5d87aa24f964516b4b34d78332237: Status 404 returned error can't find the container with id c71d6276d0511c221ebfbeeb89ca60cb7da5d87aa24f964516b4b34d78332237 Jul 01 19:24:05.607655 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:05.607619 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" event={"ID":"3fc460b5-4602-4e81-9e85-d1fecb112d2c","Type":"ContainerStarted","Data":"c71d6276d0511c221ebfbeeb89ca60cb7da5d87aa24f964516b4b34d78332237"} Jul 01 19:24:09.629653 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:09.629613 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" event={"ID":"3fc460b5-4602-4e81-9e85-d1fecb112d2c","Type":"ContainerStarted","Data":"99413e36ddacfa1bbe3697a5584276a13490f66e398d363a25ab35b524b76c6e"} Jul 01 19:24:09.651311 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:09.651259 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-59994cc79f-f5zsd" podStartSLOduration=1.169827963 podStartE2EDuration="5.651237818s" totalImagesPullingTime="4.481409855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:09.650849262 +0000 UTC m=+348.831180826" watchObservedRunningTime="2026-07-01 19:24:09.651237818 +0000 UTC m=+348.831569382" Jul 01 19:24:33.065027 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:33.064986 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:49.333014 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:49.332975 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:49.434041 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:49.434002 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.130057 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.130028 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.240708 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.240661 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.251307 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.251268 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2rdb"] Jul 01 19:24:50.258230 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.258197 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" Jul 01 19:24:50.261836 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.261809 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-x5zgx\"" Jul 01 19:24:50.262018 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.261986 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 19:24:50.262335 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.262317 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 19:24:50.268574 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.268546 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2rdb"] Jul 01 19:24:50.306227 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.306184 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp7pg\" (UniqueName: \"kubernetes.io/projected/8d81847a-31dd-4f0c-bb04-661b81119833-kube-api-access-sp7pg\") pod \"kuadrant-operator-catalog-q2rdb\" (UID: \"8d81847a-31dd-4f0c-bb04-661b81119833\") " pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" Jul 01 19:24:50.367803 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.367759 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.406873 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.406784 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp7pg\" (UniqueName: \"kubernetes.io/projected/8d81847a-31dd-4f0c-bb04-661b81119833-kube-api-access-sp7pg\") pod \"kuadrant-operator-catalog-q2rdb\" (UID: \"8d81847a-31dd-4f0c-bb04-661b81119833\") " pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" Jul 01 19:24:50.416109 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.416078 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp7pg\" (UniqueName: \"kubernetes.io/projected/8d81847a-31dd-4f0c-bb04-661b81119833-kube-api-access-sp7pg\") pod \"kuadrant-operator-catalog-q2rdb\" (UID: \"8d81847a-31dd-4f0c-bb04-661b81119833\") " pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" Jul 01 19:24:50.569734 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.569682 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" Jul 01 19:24:50.594489 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.594462 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2rdb"] Jul 01 19:24:50.701779 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.701753 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2rdb"] Jul 01 19:24:50.704245 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:24:50.704211 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d81847a_31dd_4f0c_bb04_661b81119833.slice/crio-00fcd4a33480ac0fde2836b63fc6591ac5dc3bfe65f50bb4732f6f7b30529a03 WatchSource:0}: Error finding container 00fcd4a33480ac0fde2836b63fc6591ac5dc3bfe65f50bb4732f6f7b30529a03: Status 404 returned error can't find the container with id 00fcd4a33480ac0fde2836b63fc6591ac5dc3bfe65f50bb4732f6f7b30529a03 Jul 01 19:24:50.806490 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.806455 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ctvpv"] Jul 01 19:24:50.809441 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.809405 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" Jul 01 19:24:50.809799 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.809759 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6lw8\" (UniqueName: \"kubernetes.io/projected/57e1a0e5-0375-4a4a-81fc-480de4b3d073-kube-api-access-b6lw8\") pod \"kuadrant-operator-catalog-ctvpv\" (UID: \"57e1a0e5-0375-4a4a-81fc-480de4b3d073\") " pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" Jul 01 19:24:50.810097 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.810069 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" event={"ID":"8d81847a-31dd-4f0c-bb04-661b81119833","Type":"ContainerStarted","Data":"00fcd4a33480ac0fde2836b63fc6591ac5dc3bfe65f50bb4732f6f7b30529a03"} Jul 01 19:24:50.818413 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.818379 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ctvpv"] Jul 01 19:24:50.910857 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.910816 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6lw8\" (UniqueName: \"kubernetes.io/projected/57e1a0e5-0375-4a4a-81fc-480de4b3d073-kube-api-access-b6lw8\") pod \"kuadrant-operator-catalog-ctvpv\" (UID: \"57e1a0e5-0375-4a4a-81fc-480de4b3d073\") " pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" Jul 01 19:24:50.922209 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:50.922181 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6lw8\" (UniqueName: \"kubernetes.io/projected/57e1a0e5-0375-4a4a-81fc-480de4b3d073-kube-api-access-b6lw8\") pod \"kuadrant-operator-catalog-ctvpv\" (UID: \"57e1a0e5-0375-4a4a-81fc-480de4b3d073\") " pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" Jul 01 19:24:51.119682 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:51.119649 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" Jul 01 19:24:51.247039 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:51.246940 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ctvpv"] Jul 01 19:24:51.249151 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:24:51.249123 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e1a0e5_0375_4a4a_81fc_480de4b3d073.slice/crio-e264e38f7c763d211e4247c6ffe88bce3a5375d9d0f449be74e4d7b8151c741b WatchSource:0}: Error finding container e264e38f7c763d211e4247c6ffe88bce3a5375d9d0f449be74e4d7b8151c741b: Status 404 returned error can't find the container with id e264e38f7c763d211e4247c6ffe88bce3a5375d9d0f449be74e4d7b8151c741b Jul 01 19:24:51.815860 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:51.815819 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" event={"ID":"57e1a0e5-0375-4a4a-81fc-480de4b3d073","Type":"ContainerStarted","Data":"e264e38f7c763d211e4247c6ffe88bce3a5375d9d0f449be74e4d7b8151c741b"} Jul 01 19:24:53.826674 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:53.826631 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" event={"ID":"8d81847a-31dd-4f0c-bb04-661b81119833","Type":"ContainerStarted","Data":"85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5"} Jul 01 19:24:53.827159 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:53.826677 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" podUID="8d81847a-31dd-4f0c-bb04-661b81119833" containerName="registry-server" containerID="cri-o://85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5" gracePeriod=2 Jul 01 19:24:53.828194 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:53.828168 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" event={"ID":"57e1a0e5-0375-4a4a-81fc-480de4b3d073","Type":"ContainerStarted","Data":"bf4868a270af9351d3d54a208b3d9df30493ad0488b7740b5fc60e9605346051"} Jul 01 19:24:53.847085 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:53.847044 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" podStartSLOduration=1.673151069 podStartE2EDuration="3.847029231s" totalImagesPullingTime="2.173878162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:53.844670062 +0000 UTC m=+393.025001654" watchObservedRunningTime="2026-07-01 19:24:53.847029231 +0000 UTC m=+393.027360796" Jul 01 19:24:53.861498 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:53.861447 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" podStartSLOduration=2.215510448 podStartE2EDuration="3.8614305s" totalImagesPullingTime="1.645920052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:53.860988872 +0000 UTC m=+393.041320486" watchObservedRunningTime="2026-07-01 19:24:53.8614305 +0000 UTC m=+393.041762064" Jul 01 19:24:54.069112 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.069084 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" Jul 01 19:24:54.136926 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.136888 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp7pg\" (UniqueName: \"kubernetes.io/projected/8d81847a-31dd-4f0c-bb04-661b81119833-kube-api-access-sp7pg\") pod \"8d81847a-31dd-4f0c-bb04-661b81119833\" (UID: \"8d81847a-31dd-4f0c-bb04-661b81119833\") " Jul 01 19:24:54.139077 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.139045 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d81847a-31dd-4f0c-bb04-661b81119833-kube-api-access-sp7pg" (OuterVolumeSpecName: "kube-api-access-sp7pg") pod "8d81847a-31dd-4f0c-bb04-661b81119833" (UID: "8d81847a-31dd-4f0c-bb04-661b81119833"). InnerVolumeSpecName "kube-api-access-sp7pg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:54.237517 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.237479 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp7pg\" (UniqueName: \"kubernetes.io/projected/8d81847a-31dd-4f0c-bb04-661b81119833-kube-api-access-sp7pg\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:24:54.833644 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.833611 2551 generic.go:356] "Generic (PLEG): container finished" podID="8d81847a-31dd-4f0c-bb04-661b81119833" containerID="85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5" exitCode=0 Jul 01 19:24:54.834068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.833660 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" Jul 01 19:24:54.834068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.833715 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" event={"ID":"8d81847a-31dd-4f0c-bb04-661b81119833","Type":"ContainerDied","Data":"85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5"} Jul 01 19:24:54.834068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.833764 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q2rdb" event={"ID":"8d81847a-31dd-4f0c-bb04-661b81119833","Type":"ContainerDied","Data":"00fcd4a33480ac0fde2836b63fc6591ac5dc3bfe65f50bb4732f6f7b30529a03"} Jul 01 19:24:54.834068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.833788 2551 scope.go:117] "RemoveContainer" containerID="85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5" Jul 01 19:24:54.843096 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.843078 2551 scope.go:117] "RemoveContainer" containerID="85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5" Jul 01 19:24:54.843340 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:24:54.843320 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5\": container with ID starting with 85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5 not found: ID does not exist" containerID="85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5" Jul 01 19:24:54.843388 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.843347 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5"} err="failed to get container status \"85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5\": rpc error: code = NotFound desc = could not find container \"85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5\": container with ID starting with 85df3d51afe517ad315fcd9e12f30965bb2105962116b28463737386dfea4ed5 not found: ID does not exist" Jul 01 19:24:54.855498 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.855476 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2rdb"] Jul 01 19:24:54.860780 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:54.860762 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2rdb"] Jul 01 19:24:55.255091 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:24:55.255058 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d81847a-31dd-4f0c-bb04-661b81119833" path="/var/lib/kubelet/pods/8d81847a-31dd-4f0c-bb04-661b81119833/volumes" Jul 01 19:25:01.120767 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:01.120723 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" Jul 01 19:25:01.121218 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:01.120815 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" Jul 01 19:25:01.143495 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:01.143460 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" Jul 01 19:25:01.886522 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:01.886495 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ctvpv" Jul 01 19:25:05.621295 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.621257 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q"] Jul 01 19:25:05.621726 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.621561 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81847a-31dd-4f0c-bb04-661b81119833" containerName="registry-server" Jul 01 19:25:05.621726 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.621572 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81847a-31dd-4f0c-bb04-661b81119833" containerName="registry-server" Jul 01 19:25:05.621726 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.621625 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d81847a-31dd-4f0c-bb04-661b81119833" containerName="registry-server" Jul 01 19:25:05.625998 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.625979 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.628635 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.628613 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j8mtr\"" Jul 01 19:25:05.634104 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.634080 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q"] Jul 01 19:25:05.727514 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.727468 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.727514 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.727512 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.727769 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.727542 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znjwk\" (UniqueName: \"kubernetes.io/projected/9829d4b0-1b67-4c23-9a82-8fcc23159d40-kube-api-access-znjwk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.828505 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.828465 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.828790 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.828767 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.828925 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.828823 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.829054 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.829037 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znjwk\" (UniqueName: \"kubernetes.io/projected/9829d4b0-1b67-4c23-9a82-8fcc23159d40-kube-api-access-znjwk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.829163 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.829137 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.838012 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.837983 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znjwk\" (UniqueName: \"kubernetes.io/projected/9829d4b0-1b67-4c23-9a82-8fcc23159d40-kube-api-access-znjwk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:05.935776 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:05.935645 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:06.065424 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.065398 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q"] Jul 01 19:25:06.067747 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:25:06.067710 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9829d4b0_1b67_4c23_9a82_8fcc23159d40.slice/crio-7092deab03220146cd2578c91113c4d482bceeaf440c2fb632a07d0aa9265a30 WatchSource:0}: Error finding container 7092deab03220146cd2578c91113c4d482bceeaf440c2fb632a07d0aa9265a30: Status 404 returned error can't find the container with id 7092deab03220146cd2578c91113c4d482bceeaf440c2fb632a07d0aa9265a30 Jul 01 19:25:06.421541 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.421507 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl"] Jul 01 19:25:06.424917 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.424899 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.434261 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.434234 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl"] Jul 01 19:25:06.534559 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.534524 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.534559 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.534562 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.534791 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.534755 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmprc\" (UniqueName: \"kubernetes.io/projected/9303db76-3f27-404b-948a-984239b30891-kube-api-access-pmprc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.635340 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.635305 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmprc\" (UniqueName: \"kubernetes.io/projected/9303db76-3f27-404b-948a-984239b30891-kube-api-access-pmprc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.635753 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.635363 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.635753 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.635387 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.635833 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.635764 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.635833 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.635799 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.643859 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.643826 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmprc\" (UniqueName: \"kubernetes.io/projected/9303db76-3f27-404b-948a-984239b30891-kube-api-access-pmprc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.734199 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.734119 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:06.864515 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.864428 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl"] Jul 01 19:25:06.866564 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:25:06.866539 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9303db76_3f27_404b_948a_984239b30891.slice/crio-6cc23c6d9bff98ba6390eea20e912f1188e5a84b4b96754e2378ad174b561ce2 WatchSource:0}: Error finding container 6cc23c6d9bff98ba6390eea20e912f1188e5a84b4b96754e2378ad174b561ce2: Status 404 returned error can't find the container with id 6cc23c6d9bff98ba6390eea20e912f1188e5a84b4b96754e2378ad174b561ce2 Jul 01 19:25:06.889676 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.889631 2551 generic.go:356] "Generic (PLEG): container finished" podID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerID="9dc9b00ae195dc66546a6740dbd0ef68f17b7996b5696b377aa96a8c16ebadcd" exitCode=0 Jul 01 19:25:06.889879 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.889711 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" event={"ID":"9829d4b0-1b67-4c23-9a82-8fcc23159d40","Type":"ContainerDied","Data":"9dc9b00ae195dc66546a6740dbd0ef68f17b7996b5696b377aa96a8c16ebadcd"} Jul 01 19:25:06.889879 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.889770 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" event={"ID":"9829d4b0-1b67-4c23-9a82-8fcc23159d40","Type":"ContainerStarted","Data":"7092deab03220146cd2578c91113c4d482bceeaf440c2fb632a07d0aa9265a30"} Jul 01 19:25:06.891068 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:06.891042 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" event={"ID":"9303db76-3f27-404b-948a-984239b30891","Type":"ContainerStarted","Data":"6cc23c6d9bff98ba6390eea20e912f1188e5a84b4b96754e2378ad174b561ce2"} Jul 01 19:25:07.014988 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.014954 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2"] Jul 01 19:25:07.018269 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.018253 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.027896 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.027870 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2"] Jul 01 19:25:07.039373 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.039341 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv6h4\" (UniqueName: \"kubernetes.io/projected/61598140-40e2-49e4-85f5-cb42b5a0d8e2-kube-api-access-kv6h4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.039556 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.039379 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.039556 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.039513 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.140604 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.140556 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv6h4\" (UniqueName: \"kubernetes.io/projected/61598140-40e2-49e4-85f5-cb42b5a0d8e2-kube-api-access-kv6h4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.140604 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.140603 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.140887 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.140669 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.141090 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.141068 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.141158 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.141091 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.149190 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.149164 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv6h4\" (UniqueName: \"kubernetes.io/projected/61598140-40e2-49e4-85f5-cb42b5a0d8e2-kube-api-access-kv6h4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.355135 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.355030 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:07.424430 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.424392 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg"] Jul 01 19:25:07.429358 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.429326 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.436093 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.436066 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg"] Jul 01 19:25:07.443014 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.442983 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.443223 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.443039 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.443223 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.443065 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28kmv\" (UniqueName: \"kubernetes.io/projected/3d3d05cc-9bed-4c1f-9b71-24069579dd83-kube-api-access-28kmv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.488798 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.488761 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2"] Jul 01 19:25:07.490749 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:25:07.490727 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61598140_40e2_49e4_85f5_cb42b5a0d8e2.slice/crio-9660a7218d95dfc9d3dcec381e04718345af457fcfed532918a9ca1594491d7b WatchSource:0}: Error finding container 9660a7218d95dfc9d3dcec381e04718345af457fcfed532918a9ca1594491d7b: Status 404 returned error can't find the container with id 9660a7218d95dfc9d3dcec381e04718345af457fcfed532918a9ca1594491d7b Jul 01 19:25:07.544257 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.544229 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.544485 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.544274 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.544485 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.544291 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28kmv\" (UniqueName: \"kubernetes.io/projected/3d3d05cc-9bed-4c1f-9b71-24069579dd83-kube-api-access-28kmv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.544669 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.544653 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.544743 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.544671 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.553889 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.553862 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28kmv\" (UniqueName: \"kubernetes.io/projected/3d3d05cc-9bed-4c1f-9b71-24069579dd83-kube-api-access-28kmv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.741169 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.741138 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:07.869112 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.869087 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg"] Jul 01 19:25:07.871184 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:25:07.871155 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3d05cc_9bed_4c1f_9b71_24069579dd83.slice/crio-78362c4469d075ee2d60861b1c9c1f623389678d9a0ed5410f9b0e68f41cc8ab WatchSource:0}: Error finding container 78362c4469d075ee2d60861b1c9c1f623389678d9a0ed5410f9b0e68f41cc8ab: Status 404 returned error can't find the container with id 78362c4469d075ee2d60861b1c9c1f623389678d9a0ed5410f9b0e68f41cc8ab Jul 01 19:25:07.897530 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.897496 2551 generic.go:356] "Generic (PLEG): container finished" podID="9303db76-3f27-404b-948a-984239b30891" containerID="81aa7b8f7506e95103ddc6fe49cc2099051dfa9dc1b7fc99224b4b5f2e056b63" exitCode=0 Jul 01 19:25:07.897672 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.897572 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" event={"ID":"9303db76-3f27-404b-948a-984239b30891","Type":"ContainerDied","Data":"81aa7b8f7506e95103ddc6fe49cc2099051dfa9dc1b7fc99224b4b5f2e056b63"} Jul 01 19:25:07.898995 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.898975 2551 generic.go:356] "Generic (PLEG): container finished" podID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerID="27a133f3ba1f79b257e9ac5a567dd05f6a1fd0a85f35e76102b36a7badb61968" exitCode=0 Jul 01 19:25:07.899080 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.899055 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" event={"ID":"61598140-40e2-49e4-85f5-cb42b5a0d8e2","Type":"ContainerDied","Data":"27a133f3ba1f79b257e9ac5a567dd05f6a1fd0a85f35e76102b36a7badb61968"} Jul 01 19:25:07.899151 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.899094 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" event={"ID":"61598140-40e2-49e4-85f5-cb42b5a0d8e2","Type":"ContainerStarted","Data":"9660a7218d95dfc9d3dcec381e04718345af457fcfed532918a9ca1594491d7b"} Jul 01 19:25:07.900394 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:07.900366 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" event={"ID":"3d3d05cc-9bed-4c1f-9b71-24069579dd83","Type":"ContainerStarted","Data":"78362c4469d075ee2d60861b1c9c1f623389678d9a0ed5410f9b0e68f41cc8ab"} Jul 01 19:25:08.906777 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:08.906738 2551 generic.go:356] "Generic (PLEG): container finished" podID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerID="e837091a35949853a2713da15965f6ee042825595b3b1984278013d912eb833d" exitCode=0 Jul 01 19:25:08.907182 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:08.906783 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" event={"ID":"61598140-40e2-49e4-85f5-cb42b5a0d8e2","Type":"ContainerDied","Data":"e837091a35949853a2713da15965f6ee042825595b3b1984278013d912eb833d"} Jul 01 19:25:08.908617 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:08.908594 2551 generic.go:356] "Generic (PLEG): container finished" podID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerID="a0bdf3a9bebed8397c4bbb648681d41ccabf910a42108123f9bb32e8c365047e" exitCode=0 Jul 01 19:25:08.908717 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:08.908676 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" event={"ID":"9829d4b0-1b67-4c23-9a82-8fcc23159d40","Type":"ContainerDied","Data":"a0bdf3a9bebed8397c4bbb648681d41ccabf910a42108123f9bb32e8c365047e"} Jul 01 19:25:08.910280 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:08.910258 2551 generic.go:356] "Generic (PLEG): container finished" podID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerID="e79d05c3a49efec7d839f2cf9e8a7ea9b46ef085a246691ef18a6eec7fd97045" exitCode=0 Jul 01 19:25:08.910351 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:08.910287 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" event={"ID":"3d3d05cc-9bed-4c1f-9b71-24069579dd83","Type":"ContainerDied","Data":"e79d05c3a49efec7d839f2cf9e8a7ea9b46ef085a246691ef18a6eec7fd97045"} Jul 01 19:25:09.916906 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:09.916874 2551 generic.go:356] "Generic (PLEG): container finished" podID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerID="aec00c0785c72d6e8e17fe601d97e9b3de48ed1a2eafc0c49a865d93f1817c3d" exitCode=0 Jul 01 19:25:09.917312 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:09.916953 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" event={"ID":"61598140-40e2-49e4-85f5-cb42b5a0d8e2","Type":"ContainerDied","Data":"aec00c0785c72d6e8e17fe601d97e9b3de48ed1a2eafc0c49a865d93f1817c3d"} Jul 01 19:25:09.918916 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:09.918893 2551 generic.go:356] "Generic (PLEG): container finished" podID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerID="f1ad659ef43803dad22c2d5aea7e1b4b224b615a31c9f8b41447379907feaa16" exitCode=0 Jul 01 19:25:09.919045 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:09.918971 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" event={"ID":"9829d4b0-1b67-4c23-9a82-8fcc23159d40","Type":"ContainerDied","Data":"f1ad659ef43803dad22c2d5aea7e1b4b224b615a31c9f8b41447379907feaa16"} Jul 01 19:25:09.920529 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:09.920505 2551 generic.go:356] "Generic (PLEG): container finished" podID="9303db76-3f27-404b-948a-984239b30891" containerID="c7ef95c69081fcebb142f49a89fcb944297039b06a342c1f65b2254aafb28861" exitCode=0 Jul 01 19:25:09.920635 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:09.920554 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" event={"ID":"9303db76-3f27-404b-948a-984239b30891","Type":"ContainerDied","Data":"c7ef95c69081fcebb142f49a89fcb944297039b06a342c1f65b2254aafb28861"} Jul 01 19:25:10.928060 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:10.928023 2551 generic.go:356] "Generic (PLEG): container finished" podID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerID="ee6e72916c94b013c82b17e5a7efe60507140b9716f0dac0b36b70f8cdfdff20" exitCode=0 Jul 01 19:25:10.928481 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:10.928100 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" event={"ID":"3d3d05cc-9bed-4c1f-9b71-24069579dd83","Type":"ContainerDied","Data":"ee6e72916c94b013c82b17e5a7efe60507140b9716f0dac0b36b70f8cdfdff20"} Jul 01 19:25:10.930354 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:10.930329 2551 generic.go:356] "Generic (PLEG): container finished" podID="9303db76-3f27-404b-948a-984239b30891" containerID="f4d331a13e8f52f4c355e1880fc78c8b00fd0a09297851b9fed4b18147a417a7" exitCode=0 Jul 01 19:25:10.930450 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:10.930399 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" event={"ID":"9303db76-3f27-404b-948a-984239b30891","Type":"ContainerDied","Data":"f4d331a13e8f52f4c355e1880fc78c8b00fd0a09297851b9fed4b18147a417a7"} Jul 01 19:25:11.072890 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.072861 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:11.141006 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.140977 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:11.175882 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.175855 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv6h4\" (UniqueName: \"kubernetes.io/projected/61598140-40e2-49e4-85f5-cb42b5a0d8e2-kube-api-access-kv6h4\") pod \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " Jul 01 19:25:11.176041 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.175950 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-bundle\") pod \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " Jul 01 19:25:11.176041 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.175981 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-util\") pod \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " Jul 01 19:25:11.176041 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.176011 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-bundle\") pod \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " Jul 01 19:25:11.176041 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.176035 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znjwk\" (UniqueName: \"kubernetes.io/projected/9829d4b0-1b67-4c23-9a82-8fcc23159d40-kube-api-access-znjwk\") pod \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\" (UID: \"9829d4b0-1b67-4c23-9a82-8fcc23159d40\") " Jul 01 19:25:11.176271 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.176060 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-util\") pod \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\" (UID: \"61598140-40e2-49e4-85f5-cb42b5a0d8e2\") " Jul 01 19:25:11.176649 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.176597 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-bundle" (OuterVolumeSpecName: "bundle") pod "61598140-40e2-49e4-85f5-cb42b5a0d8e2" (UID: "61598140-40e2-49e4-85f5-cb42b5a0d8e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:11.176909 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.176879 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-bundle" (OuterVolumeSpecName: "bundle") pod "9829d4b0-1b67-4c23-9a82-8fcc23159d40" (UID: "9829d4b0-1b67-4c23-9a82-8fcc23159d40"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:11.178287 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.178226 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9829d4b0-1b67-4c23-9a82-8fcc23159d40-kube-api-access-znjwk" (OuterVolumeSpecName: "kube-api-access-znjwk") pod "9829d4b0-1b67-4c23-9a82-8fcc23159d40" (UID: "9829d4b0-1b67-4c23-9a82-8fcc23159d40"). InnerVolumeSpecName "kube-api-access-znjwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:11.178420 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.178395 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61598140-40e2-49e4-85f5-cb42b5a0d8e2-kube-api-access-kv6h4" (OuterVolumeSpecName: "kube-api-access-kv6h4") pod "61598140-40e2-49e4-85f5-cb42b5a0d8e2" (UID: "61598140-40e2-49e4-85f5-cb42b5a0d8e2"). InnerVolumeSpecName "kube-api-access-kv6h4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:11.181724 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.181678 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-util" (OuterVolumeSpecName: "util") pod "9829d4b0-1b67-4c23-9a82-8fcc23159d40" (UID: "9829d4b0-1b67-4c23-9a82-8fcc23159d40"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:11.182064 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.182046 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-util" (OuterVolumeSpecName: "util") pod "61598140-40e2-49e4-85f5-cb42b5a0d8e2" (UID: "61598140-40e2-49e4-85f5-cb42b5a0d8e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:11.277029 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.276995 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv6h4\" (UniqueName: \"kubernetes.io/projected/61598140-40e2-49e4-85f5-cb42b5a0d8e2-kube-api-access-kv6h4\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:11.277029 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.277025 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-bundle\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:11.277029 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.277035 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-util\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:11.277222 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.277043 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829d4b0-1b67-4c23-9a82-8fcc23159d40-bundle\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:11.277222 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.277050 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znjwk\" (UniqueName: \"kubernetes.io/projected/9829d4b0-1b67-4c23-9a82-8fcc23159d40-kube-api-access-znjwk\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:11.277222 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.277057 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61598140-40e2-49e4-85f5-cb42b5a0d8e2-util\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:11.937126 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.937094 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" Jul 01 19:25:11.937578 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.937095 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2" event={"ID":"61598140-40e2-49e4-85f5-cb42b5a0d8e2","Type":"ContainerDied","Data":"9660a7218d95dfc9d3dcec381e04718345af457fcfed532918a9ca1594491d7b"} Jul 01 19:25:11.937578 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.937227 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9660a7218d95dfc9d3dcec381e04718345af457fcfed532918a9ca1594491d7b" Jul 01 19:25:11.939002 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.938971 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" event={"ID":"9829d4b0-1b67-4c23-9a82-8fcc23159d40","Type":"ContainerDied","Data":"7092deab03220146cd2578c91113c4d482bceeaf440c2fb632a07d0aa9265a30"} Jul 01 19:25:11.939002 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.938995 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q" Jul 01 19:25:11.939288 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.939018 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7092deab03220146cd2578c91113c4d482bceeaf440c2fb632a07d0aa9265a30" Jul 01 19:25:11.941320 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.941298 2551 generic.go:356] "Generic (PLEG): container finished" podID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerID="1b3dd932c2fe53f450057e073012f60b862e4aea0d9e7c7bf971f9d59021b891" exitCode=0 Jul 01 19:25:11.941406 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:11.941378 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" event={"ID":"3d3d05cc-9bed-4c1f-9b71-24069579dd83","Type":"ContainerDied","Data":"1b3dd932c2fe53f450057e073012f60b862e4aea0d9e7c7bf971f9d59021b891"} Jul 01 19:25:12.076127 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.076101 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:12.182191 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.182160 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-util\") pod \"9303db76-3f27-404b-948a-984239b30891\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " Jul 01 19:25:12.182358 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.182233 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmprc\" (UniqueName: \"kubernetes.io/projected/9303db76-3f27-404b-948a-984239b30891-kube-api-access-pmprc\") pod \"9303db76-3f27-404b-948a-984239b30891\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " Jul 01 19:25:12.182358 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.182324 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-bundle\") pod \"9303db76-3f27-404b-948a-984239b30891\" (UID: \"9303db76-3f27-404b-948a-984239b30891\") " Jul 01 19:25:12.182864 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.182830 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-bundle" (OuterVolumeSpecName: "bundle") pod "9303db76-3f27-404b-948a-984239b30891" (UID: "9303db76-3f27-404b-948a-984239b30891"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:12.184476 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.184442 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9303db76-3f27-404b-948a-984239b30891-kube-api-access-pmprc" (OuterVolumeSpecName: "kube-api-access-pmprc") pod "9303db76-3f27-404b-948a-984239b30891" (UID: "9303db76-3f27-404b-948a-984239b30891"). InnerVolumeSpecName "kube-api-access-pmprc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:12.259763 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.259715 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-util" (OuterVolumeSpecName: "util") pod "9303db76-3f27-404b-948a-984239b30891" (UID: "9303db76-3f27-404b-948a-984239b30891"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:12.283262 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.283233 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmprc\" (UniqueName: \"kubernetes.io/projected/9303db76-3f27-404b-948a-984239b30891-kube-api-access-pmprc\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:12.283262 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.283262 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-bundle\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:12.283385 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.283273 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9303db76-3f27-404b-948a-984239b30891-util\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:12.948150 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.948118 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" event={"ID":"9303db76-3f27-404b-948a-984239b30891","Type":"ContainerDied","Data":"6cc23c6d9bff98ba6390eea20e912f1188e5a84b4b96754e2378ad174b561ce2"} Jul 01 19:25:12.948526 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.948156 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl" Jul 01 19:25:12.948526 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:12.948166 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cc23c6d9bff98ba6390eea20e912f1188e5a84b4b96754e2378ad174b561ce2" Jul 01 19:25:13.078530 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.078506 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:13.190478 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.190435 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-util\") pod \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " Jul 01 19:25:13.190640 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.190499 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-bundle\") pod \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " Jul 01 19:25:13.190640 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.190572 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28kmv\" (UniqueName: \"kubernetes.io/projected/3d3d05cc-9bed-4c1f-9b71-24069579dd83-kube-api-access-28kmv\") pod \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\" (UID: \"3d3d05cc-9bed-4c1f-9b71-24069579dd83\") " Jul 01 19:25:13.191022 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.190992 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-bundle" (OuterVolumeSpecName: "bundle") pod "3d3d05cc-9bed-4c1f-9b71-24069579dd83" (UID: "3d3d05cc-9bed-4c1f-9b71-24069579dd83"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:13.192668 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.192629 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3d05cc-9bed-4c1f-9b71-24069579dd83-kube-api-access-28kmv" (OuterVolumeSpecName: "kube-api-access-28kmv") pod "3d3d05cc-9bed-4c1f-9b71-24069579dd83" (UID: "3d3d05cc-9bed-4c1f-9b71-24069579dd83"). InnerVolumeSpecName "kube-api-access-28kmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:13.291410 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.291314 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28kmv\" (UniqueName: \"kubernetes.io/projected/3d3d05cc-9bed-4c1f-9b71-24069579dd83-kube-api-access-28kmv\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:13.291410 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.291346 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-bundle\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:13.307967 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.307927 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-util" (OuterVolumeSpecName: "util") pod "3d3d05cc-9bed-4c1f-9b71-24069579dd83" (UID: "3d3d05cc-9bed-4c1f-9b71-24069579dd83"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:13.392593 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.392558 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d3d05cc-9bed-4c1f-9b71-24069579dd83-util\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:13.954108 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.954075 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" Jul 01 19:25:13.954108 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.954098 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg" event={"ID":"3d3d05cc-9bed-4c1f-9b71-24069579dd83","Type":"ContainerDied","Data":"78362c4469d075ee2d60861b1c9c1f623389678d9a0ed5410f9b0e68f41cc8ab"} Jul 01 19:25:13.954514 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:13.954145 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78362c4469d075ee2d60861b1c9c1f623389678d9a0ed5410f9b0e68f41cc8ab" Jul 01 19:25:21.213401 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:21.213370 2551 scope.go:117] "RemoveContainer" containerID="74e37b97a5f193338cf9efedd7d854a45943f7b29f61023d3415d6a68f17b413" Jul 01 19:25:21.652590 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:21.652556 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:22.640191 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:22.640155 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:26.359874 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.359835 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp"] Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360106 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerName="util" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360117 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerName="util" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360126 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9303db76-3f27-404b-948a-984239b30891" containerName="extract" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360131 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="9303db76-3f27-404b-948a-984239b30891" containerName="extract" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360142 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerName="pull" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360148 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerName="pull" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360155 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9303db76-3f27-404b-948a-984239b30891" containerName="pull" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360160 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="9303db76-3f27-404b-948a-984239b30891" containerName="pull" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360167 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerName="extract" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360171 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerName="extract" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360177 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerName="pull" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360182 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerName="pull" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360188 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerName="extract" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360192 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerName="extract" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360199 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerName="util" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360204 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerName="util" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360211 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9303db76-3f27-404b-948a-984239b30891" containerName="util" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360215 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="9303db76-3f27-404b-948a-984239b30891" containerName="util" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360222 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerName="pull" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360226 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerName="pull" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360232 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerName="util" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360238 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerName="util" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360244 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerName="extract" Jul 01 19:25:26.360256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360248 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerName="extract" Jul 01 19:25:26.360958 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360293 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="61598140-40e2-49e4-85f5-cb42b5a0d8e2" containerName="extract" Jul 01 19:25:26.360958 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360299 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="9829d4b0-1b67-4c23-9a82-8fcc23159d40" containerName="extract" Jul 01 19:25:26.360958 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360304 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d3d05cc-9bed-4c1f-9b71-24069579dd83" containerName="extract" Jul 01 19:25:26.360958 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.360311 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="9303db76-3f27-404b-948a-984239b30891" containerName="extract" Jul 01 19:25:26.367423 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.367402 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" Jul 01 19:25:26.370457 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.370436 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-stsg4\"" Jul 01 19:25:26.376164 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.376138 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp"] Jul 01 19:25:26.492032 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.491989 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlhc8\" (UniqueName: \"kubernetes.io/projected/4833a7aa-b8c1-40f2-be86-4489802ccdb4-kube-api-access-wlhc8\") pod \"authorino-operator-75cc8d5cb7-7kqcp\" (UID: \"4833a7aa-b8c1-40f2-be86-4489802ccdb4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" Jul 01 19:25:26.592575 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.592531 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlhc8\" (UniqueName: \"kubernetes.io/projected/4833a7aa-b8c1-40f2-be86-4489802ccdb4-kube-api-access-wlhc8\") pod \"authorino-operator-75cc8d5cb7-7kqcp\" (UID: \"4833a7aa-b8c1-40f2-be86-4489802ccdb4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" Jul 01 19:25:26.605559 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.605529 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlhc8\" (UniqueName: \"kubernetes.io/projected/4833a7aa-b8c1-40f2-be86-4489802ccdb4-kube-api-access-wlhc8\") pod \"authorino-operator-75cc8d5cb7-7kqcp\" (UID: \"4833a7aa-b8c1-40f2-be86-4489802ccdb4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" Jul 01 19:25:26.678665 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.678565 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" Jul 01 19:25:26.817917 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:26.817890 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp"] Jul 01 19:25:26.819759 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:25:26.819722 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4833a7aa_b8c1_40f2_be86_4489802ccdb4.slice/crio-fcf0d0f8386c1600896b37292dc7d88318dd85da0f601d70c349599162fc8f8e WatchSource:0}: Error finding container fcf0d0f8386c1600896b37292dc7d88318dd85da0f601d70c349599162fc8f8e: Status 404 returned error can't find the container with id fcf0d0f8386c1600896b37292dc7d88318dd85da0f601d70c349599162fc8f8e Jul 01 19:25:27.014969 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:27.014865 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" event={"ID":"4833a7aa-b8c1-40f2-be86-4489802ccdb4","Type":"ContainerStarted","Data":"fcf0d0f8386c1600896b37292dc7d88318dd85da0f601d70c349599162fc8f8e"} Jul 01 19:25:27.883355 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:27.883304 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:29.680359 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:29.680316 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5"] Jul 01 19:25:29.683880 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:29.683855 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" Jul 01 19:25:29.686375 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:29.686356 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xktrz\"" Jul 01 19:25:29.686487 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:29.686428 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 19:25:29.693944 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:29.693918 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5"] Jul 01 19:25:29.823168 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:29.823109 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjr7h\" (UniqueName: \"kubernetes.io/projected/b50b10ba-8ea0-4b60-9645-369a8b376a03-kube-api-access-vjr7h\") pod \"dns-operator-controller-manager-864dd78c4c-bjzk5\" (UID: \"b50b10ba-8ea0-4b60-9645-369a8b376a03\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" Jul 01 19:25:29.924549 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:29.924511 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjr7h\" (UniqueName: \"kubernetes.io/projected/b50b10ba-8ea0-4b60-9645-369a8b376a03-kube-api-access-vjr7h\") pod \"dns-operator-controller-manager-864dd78c4c-bjzk5\" (UID: \"b50b10ba-8ea0-4b60-9645-369a8b376a03\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" Jul 01 19:25:29.937570 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:29.937496 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjr7h\" (UniqueName: \"kubernetes.io/projected/b50b10ba-8ea0-4b60-9645-369a8b376a03-kube-api-access-vjr7h\") pod \"dns-operator-controller-manager-864dd78c4c-bjzk5\" (UID: \"b50b10ba-8ea0-4b60-9645-369a8b376a03\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" Jul 01 19:25:29.995197 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:29.995161 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" Jul 01 19:25:30.032071 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:30.032036 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" event={"ID":"4833a7aa-b8c1-40f2-be86-4489802ccdb4","Type":"ContainerStarted","Data":"156cb9f96c297e14f2842b74d5e1d8aaeecdc9de30fd5aad20f5be15d7a57500"} Jul 01 19:25:30.032269 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:30.032200 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" Jul 01 19:25:30.052115 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:30.052056 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" podStartSLOduration=1.6885758210000001 podStartE2EDuration="4.052031258s" totalImagesPullingTime="2.363455437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:30.051188422 +0000 UTC m=+429.231520009" watchObservedRunningTime="2026-07-01 19:25:30.052031258 +0000 UTC m=+429.232362825" Jul 01 19:25:30.152209 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:30.151978 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5"] Jul 01 19:25:30.154351 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:25:30.154320 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50b10ba_8ea0_4b60_9645_369a8b376a03.slice/crio-6e6f97ab31cb67bf13e7f1e51653dbac437b14fe8acf5059fe1f548a9e73fc1c WatchSource:0}: Error finding container 6e6f97ab31cb67bf13e7f1e51653dbac437b14fe8acf5059fe1f548a9e73fc1c: Status 404 returned error can't find the container with id 6e6f97ab31cb67bf13e7f1e51653dbac437b14fe8acf5059fe1f548a9e73fc1c Jul 01 19:25:30.995009 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:30.994977 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:31.039867 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:31.039828 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" event={"ID":"b50b10ba-8ea0-4b60-9645-369a8b376a03","Type":"ContainerStarted","Data":"6e6f97ab31cb67bf13e7f1e51653dbac437b14fe8acf5059fe1f548a9e73fc1c"} Jul 01 19:25:31.153563 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:31.153516 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:31.257666 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:31.257571 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:32.924161 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:32.924119 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:33.052007 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:33.051976 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" event={"ID":"b50b10ba-8ea0-4b60-9645-369a8b376a03","Type":"ContainerStarted","Data":"b9b1f33ed86537b7bd2bb2e9035c4887dbe921762097332184b92f4b864628a6"} Jul 01 19:25:33.052183 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:33.052091 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" Jul 01 19:25:33.075043 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:33.074996 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" podStartSLOduration=2.095162765 podStartE2EDuration="4.074982954s" totalImagesPullingTime="1.979820189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:33.073846888 +0000 UTC m=+432.254178457" watchObservedRunningTime="2026-07-01 19:25:33.074982954 +0000 UTC m=+432.255314517" Jul 01 19:25:33.672203 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:33.672170 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:34.153277 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:34.153242 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:36.091328 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:36.091273 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:37.930394 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:37.930359 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq"] Jul 01 19:25:37.933630 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:37.933610 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:37.936578 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:37.936558 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-crhh4\"" Jul 01 19:25:37.948654 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:37.948620 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq"] Jul 01 19:25:38.091274 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.091236 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ebfd860-e334-4541-b795-3a036313cde7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" (UID: \"3ebfd860-e334-4541-b795-3a036313cde7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:38.091274 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.091277 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6rh\" (UniqueName: \"kubernetes.io/projected/3ebfd860-e334-4541-b795-3a036313cde7-kube-api-access-rv6rh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" (UID: \"3ebfd860-e334-4541-b795-3a036313cde7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:38.192059 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.191973 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ebfd860-e334-4541-b795-3a036313cde7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" (UID: \"3ebfd860-e334-4541-b795-3a036313cde7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:38.192059 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.192010 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6rh\" (UniqueName: \"kubernetes.io/projected/3ebfd860-e334-4541-b795-3a036313cde7-kube-api-access-rv6rh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" (UID: \"3ebfd860-e334-4541-b795-3a036313cde7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:38.192406 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.192385 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ebfd860-e334-4541-b795-3a036313cde7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" (UID: \"3ebfd860-e334-4541-b795-3a036313cde7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:38.200944 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.200910 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6rh\" (UniqueName: \"kubernetes.io/projected/3ebfd860-e334-4541-b795-3a036313cde7-kube-api-access-rv6rh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" (UID: \"3ebfd860-e334-4541-b795-3a036313cde7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:38.243361 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.243318 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:38.379166 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.379129 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq"] Jul 01 19:25:38.382616 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:25:38.382580 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebfd860_e334_4541_b795_3a036313cde7.slice/crio-c14e7634164a12a86df9a72a6f9e09f3d76dfcc35cda0a4f8eff8069eff46875 WatchSource:0}: Error finding container c14e7634164a12a86df9a72a6f9e09f3d76dfcc35cda0a4f8eff8069eff46875: Status 404 returned error can't find the container with id c14e7634164a12a86df9a72a6f9e09f3d76dfcc35cda0a4f8eff8069eff46875 Jul 01 19:25:38.851522 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.851482 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:38.952814 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:38.952778 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:39.058098 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:39.058058 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:39.081412 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:39.081378 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" event={"ID":"3ebfd860-e334-4541-b795-3a036313cde7","Type":"ContainerStarted","Data":"c14e7634164a12a86df9a72a6f9e09f3d76dfcc35cda0a4f8eff8069eff46875"} Jul 01 19:25:39.156901 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:39.156853 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:41.042760 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:41.042725 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7kqcp" Jul 01 19:25:42.871883 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:42.871768 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:42.942314 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:42.942244 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:44.059685 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:44.059591 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bjzk5" Jul 01 19:25:44.111242 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:44.111205 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" event={"ID":"3ebfd860-e334-4541-b795-3a036313cde7","Type":"ContainerStarted","Data":"1d2b4b697c17304c9b089fa3ce0af79a2fc372340d3c23f7bf2f1ca98dcca43b"} Jul 01 19:25:44.111409 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:44.111333 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:44.136716 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:44.136638 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" podStartSLOduration=1.810600622 podStartE2EDuration="7.13661993s" totalImagesPullingTime="5.326019308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:44.134880478 +0000 UTC m=+443.315212081" watchObservedRunningTime="2026-07-01 19:25:44.13661993 +0000 UTC m=+443.316951493" Jul 01 19:25:46.503452 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:46.503408 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:46.664603 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:46.664559 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:47.304532 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:47.304498 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:47.401338 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:47.401300 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:50.516441 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:50.516399 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:50.625709 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:50.625652 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:55.118649 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:55.118617 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:56.679682 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.679645 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9"] Jul 01 19:25:56.686284 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.686250 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:56.698928 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.698901 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9"] Jul 01 19:25:56.848083 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.848038 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dd48129-183a-4946-b11a-0cad44bfc4e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" (UID: \"4dd48129-183a-4946-b11a-0cad44bfc4e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:56.848284 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.848106 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjr4\" (UniqueName: \"kubernetes.io/projected/4dd48129-183a-4946-b11a-0cad44bfc4e7-kube-api-access-5hjr4\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" (UID: \"4dd48129-183a-4946-b11a-0cad44bfc4e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:56.948862 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.948761 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjr4\" (UniqueName: \"kubernetes.io/projected/4dd48129-183a-4946-b11a-0cad44bfc4e7-kube-api-access-5hjr4\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" (UID: \"4dd48129-183a-4946-b11a-0cad44bfc4e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:56.949051 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.948886 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dd48129-183a-4946-b11a-0cad44bfc4e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" (UID: \"4dd48129-183a-4946-b11a-0cad44bfc4e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:56.949390 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.949365 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dd48129-183a-4946-b11a-0cad44bfc4e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" (UID: \"4dd48129-183a-4946-b11a-0cad44bfc4e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:56.951193 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.951174 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9"] Jul 01 19:25:56.951413 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:56.951394 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5hjr4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" podUID="4dd48129-183a-4946-b11a-0cad44bfc4e7" Jul 01 19:25:56.972523 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.972490 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjr4\" (UniqueName: \"kubernetes.io/projected/4dd48129-183a-4946-b11a-0cad44bfc4e7-kube-api-access-5hjr4\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" (UID: \"4dd48129-183a-4946-b11a-0cad44bfc4e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:56.974350 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.974321 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9"] Jul 01 19:25:56.990230 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.990195 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq"] Jul 01 19:25:56.990435 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.990410 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" podUID="3ebfd860-e334-4541-b795-3a036313cde7" containerName="manager" containerID="cri-o://1d2b4b697c17304c9b089fa3ce0af79a2fc372340d3c23f7bf2f1ca98dcca43b" gracePeriod=2 Jul 01 19:25:56.996099 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:56.996072 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c"] Jul 01 19:25:57.000202 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.000171 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq"] Jul 01 19:25:57.000336 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.000312 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:25:57.003328 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:57.003288 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" is forbidden: User \"system:node:ip-10-0-143-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-127.ec2.internal' and this object" podUID="3ebfd860-e334-4541-b795-3a036313cde7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:57.020039 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.020006 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c"] Jul 01 19:25:57.035579 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.035546 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j"] Jul 01 19:25:57.036104 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.036083 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ebfd860-e334-4541-b795-3a036313cde7" containerName="manager" Jul 01 19:25:57.036183 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.036108 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ebfd860-e334-4541-b795-3a036313cde7" containerName="manager" Jul 01 19:25:57.036225 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.036213 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ebfd860-e334-4541-b795-3a036313cde7" containerName="manager" Jul 01 19:25:57.040138 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.040114 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:25:57.059337 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.059306 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j"] Jul 01 19:25:57.101816 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:57.101772 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" is forbidden: User \"system:node:ip-10-0-143-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-127.ec2.internal' and this object" podUID="3ebfd860-e334-4541-b795-3a036313cde7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:57.151471 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.151420 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sms4j\" (UID: \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:25:57.151648 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.151485 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e338f6d-8553-4807-8561-3bbd625dd2d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xpc2c\" (UID: \"2e338f6d-8553-4807-8561-3bbd625dd2d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:25:57.151648 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.151579 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67w97\" (UniqueName: \"kubernetes.io/projected/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-kube-api-access-67w97\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sms4j\" (UID: \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:25:57.151648 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.151619 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x99rs\" (UniqueName: \"kubernetes.io/projected/2e338f6d-8553-4807-8561-3bbd625dd2d9-kube-api-access-x99rs\") pod \"kuadrant-operator-controller-manager-55467d9f7-xpc2c\" (UID: \"2e338f6d-8553-4807-8561-3bbd625dd2d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:25:57.180221 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.180190 2551 generic.go:356] "Generic (PLEG): container finished" podID="3ebfd860-e334-4541-b795-3a036313cde7" containerID="1d2b4b697c17304c9b089fa3ce0af79a2fc372340d3c23f7bf2f1ca98dcca43b" exitCode=0 Jul 01 19:25:57.180368 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.180325 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:57.185353 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:57.185319 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" is forbidden: User \"system:node:ip-10-0-143-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-127.ec2.internal' and this object" podUID="3ebfd860-e334-4541-b795-3a036313cde7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:57.187225 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.187205 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:57.187743 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:57.187720 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" is forbidden: User \"system:node:ip-10-0-143-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-127.ec2.internal' and this object" podUID="4dd48129-183a-4946-b11a-0cad44bfc4e7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:57.189875 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:57.189850 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" is forbidden: User \"system:node:ip-10-0-143-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-127.ec2.internal' and this object" podUID="4dd48129-183a-4946-b11a-0cad44bfc4e7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:57.191843 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:57.191820 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" is forbidden: User \"system:node:ip-10-0-143-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-127.ec2.internal' and this object" podUID="3ebfd860-e334-4541-b795-3a036313cde7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:57.231841 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.231816 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:57.234817 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:57.234788 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dt4bq\" is forbidden: User \"system:node:ip-10-0-143-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-127.ec2.internal' and this object" podUID="3ebfd860-e334-4541-b795-3a036313cde7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:57.237190 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:57.237162 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" is forbidden: User \"system:node:ip-10-0-143-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-127.ec2.internal' and this object" podUID="4dd48129-183a-4946-b11a-0cad44bfc4e7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:57.252740 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.252703 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sms4j\" (UID: \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:25:57.252923 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.252761 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e338f6d-8553-4807-8561-3bbd625dd2d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xpc2c\" (UID: \"2e338f6d-8553-4807-8561-3bbd625dd2d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:25:57.252923 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.252862 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67w97\" (UniqueName: \"kubernetes.io/projected/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-kube-api-access-67w97\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sms4j\" (UID: \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:25:57.252923 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.252921 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x99rs\" (UniqueName: \"kubernetes.io/projected/2e338f6d-8553-4807-8561-3bbd625dd2d9-kube-api-access-x99rs\") pod \"kuadrant-operator-controller-manager-55467d9f7-xpc2c\" (UID: \"2e338f6d-8553-4807-8561-3bbd625dd2d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:25:57.253168 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.253144 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sms4j\" (UID: \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:25:57.253230 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.253178 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e338f6d-8553-4807-8561-3bbd625dd2d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xpc2c\" (UID: \"2e338f6d-8553-4807-8561-3bbd625dd2d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:25:57.266111 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.266078 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67w97\" (UniqueName: \"kubernetes.io/projected/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-kube-api-access-67w97\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sms4j\" (UID: \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:25:57.266250 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.266234 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x99rs\" (UniqueName: \"kubernetes.io/projected/2e338f6d-8553-4807-8561-3bbd625dd2d9-kube-api-access-x99rs\") pod \"kuadrant-operator-controller-manager-55467d9f7-xpc2c\" (UID: \"2e338f6d-8553-4807-8561-3bbd625dd2d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:25:57.354120 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.354081 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dd48129-183a-4946-b11a-0cad44bfc4e7-extensions-socket-volume\") pod \"4dd48129-183a-4946-b11a-0cad44bfc4e7\" (UID: \"4dd48129-183a-4946-b11a-0cad44bfc4e7\") " Jul 01 19:25:57.354286 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.354142 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ebfd860-e334-4541-b795-3a036313cde7-extensions-socket-volume\") pod \"3ebfd860-e334-4541-b795-3a036313cde7\" (UID: \"3ebfd860-e334-4541-b795-3a036313cde7\") " Jul 01 19:25:57.354286 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.354168 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hjr4\" (UniqueName: \"kubernetes.io/projected/4dd48129-183a-4946-b11a-0cad44bfc4e7-kube-api-access-5hjr4\") pod \"4dd48129-183a-4946-b11a-0cad44bfc4e7\" (UID: \"4dd48129-183a-4946-b11a-0cad44bfc4e7\") " Jul 01 19:25:57.354286 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.354205 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv6rh\" (UniqueName: \"kubernetes.io/projected/3ebfd860-e334-4541-b795-3a036313cde7-kube-api-access-rv6rh\") pod \"3ebfd860-e334-4541-b795-3a036313cde7\" (UID: \"3ebfd860-e334-4541-b795-3a036313cde7\") " Jul 01 19:25:57.354448 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.354421 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd48129-183a-4946-b11a-0cad44bfc4e7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4dd48129-183a-4946-b11a-0cad44bfc4e7" (UID: "4dd48129-183a-4946-b11a-0cad44bfc4e7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:57.354663 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.354638 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ebfd860-e334-4541-b795-3a036313cde7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3ebfd860-e334-4541-b795-3a036313cde7" (UID: "3ebfd860-e334-4541-b795-3a036313cde7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:57.356326 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.356296 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ebfd860-e334-4541-b795-3a036313cde7-kube-api-access-rv6rh" (OuterVolumeSpecName: "kube-api-access-rv6rh") pod "3ebfd860-e334-4541-b795-3a036313cde7" (UID: "3ebfd860-e334-4541-b795-3a036313cde7"). InnerVolumeSpecName "kube-api-access-rv6rh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:57.356411 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.356339 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd48129-183a-4946-b11a-0cad44bfc4e7-kube-api-access-5hjr4" (OuterVolumeSpecName: "kube-api-access-5hjr4") pod "4dd48129-183a-4946-b11a-0cad44bfc4e7" (UID: "4dd48129-183a-4946-b11a-0cad44bfc4e7"). InnerVolumeSpecName "kube-api-access-5hjr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:57.374650 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.374599 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:25:57.380218 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.380196 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:25:57.455377 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.455344 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ebfd860-e334-4541-b795-3a036313cde7-extensions-socket-volume\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:57.455377 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.455371 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hjr4\" (UniqueName: \"kubernetes.io/projected/4dd48129-183a-4946-b11a-0cad44bfc4e7-kube-api-access-5hjr4\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:57.455377 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.455383 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv6rh\" (UniqueName: \"kubernetes.io/projected/3ebfd860-e334-4541-b795-3a036313cde7-kube-api-access-rv6rh\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:57.455673 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.455391 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dd48129-183a-4946-b11a-0cad44bfc4e7-extensions-socket-volume\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:25:57.539506 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.539470 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c"] Jul 01 19:25:57.540898 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:25:57.540866 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e338f6d_8553_4807_8561_3bbd625dd2d9.slice/crio-aa1b77e6cfc87e4cd5e2f5dabfd8bca2156110dbfae5075a12b494d13e6200cc WatchSource:0}: Error finding container aa1b77e6cfc87e4cd5e2f5dabfd8bca2156110dbfae5075a12b494d13e6200cc: Status 404 returned error can't find the container with id aa1b77e6cfc87e4cd5e2f5dabfd8bca2156110dbfae5075a12b494d13e6200cc Jul 01 19:25:57.546359 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:57.546335 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j"] Jul 01 19:25:57.548167 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:25:57.548141 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20eebe5_813d_43e8_a118_2c3b8ee10d3e.slice/crio-efb01c225287a2a607a73b9ae7a246a60c5892357af542cd4336fa9f4867e6f2 WatchSource:0}: Error finding container efb01c225287a2a607a73b9ae7a246a60c5892357af542cd4336fa9f4867e6f2: Status 404 returned error can't find the container with id efb01c225287a2a607a73b9ae7a246a60c5892357af542cd4336fa9f4867e6f2 Jul 01 19:25:58.186838 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.186803 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dt4bq" Jul 01 19:25:58.188516 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.188481 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" event={"ID":"f20eebe5-813d-43e8-a118-2c3b8ee10d3e","Type":"ContainerStarted","Data":"c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677"} Jul 01 19:25:58.188671 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.188553 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" event={"ID":"f20eebe5-813d-43e8-a118-2c3b8ee10d3e","Type":"ContainerStarted","Data":"efb01c225287a2a607a73b9ae7a246a60c5892357af542cd4336fa9f4867e6f2"} Jul 01 19:25:58.188671 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.188586 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:25:58.190080 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.190059 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:58.190200 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.190080 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" event={"ID":"2e338f6d-8553-4807-8561-3bbd625dd2d9","Type":"ContainerStarted","Data":"cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932"} Jul 01 19:25:58.190200 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.190124 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" event={"ID":"2e338f6d-8553-4807-8561-3bbd625dd2d9","Type":"ContainerStarted","Data":"aa1b77e6cfc87e4cd5e2f5dabfd8bca2156110dbfae5075a12b494d13e6200cc"} Jul 01 19:25:58.190200 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.190173 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:25:58.197425 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.186827 2551 scope.go:117] "RemoveContainer" containerID="1d2b4b697c17304c9b089fa3ce0af79a2fc372340d3c23f7bf2f1ca98dcca43b" Jul 01 19:25:58.210509 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.210461 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" podStartSLOduration=1.210444969 podStartE2EDuration="1.210444969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:58.208210027 +0000 UTC m=+457.388541591" watchObservedRunningTime="2026-07-01 19:25:58.210444969 +0000 UTC m=+457.390776533" Jul 01 19:25:58.212174 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:25:58.212148 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lxkc9\" is forbidden: User \"system:node:ip-10-0-143-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-127.ec2.internal' and this object" podUID="4dd48129-183a-4946-b11a-0cad44bfc4e7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxkc9" Jul 01 19:25:58.233382 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.233274 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" podStartSLOduration=2.233255446 podStartE2EDuration="2.233255446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:58.232197004 +0000 UTC m=+457.412528568" watchObservedRunningTime="2026-07-01 19:25:58.233255446 +0000 UTC m=+457.413587009" Jul 01 19:25:58.557894 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.557798 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:58.654384 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:58.654349 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:59.168719 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:59.168659 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:59.255126 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:59.255089 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ebfd860-e334-4541-b795-3a036313cde7" path="/var/lib/kubelet/pods/3ebfd860-e334-4541-b795-3a036313cde7/volumes" Jul 01 19:25:59.255502 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:59.255438 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dd48129-183a-4946-b11a-0cad44bfc4e7" path="/var/lib/kubelet/pods/4dd48129-183a-4946-b11a-0cad44bfc4e7/volumes" Jul 01 19:25:59.270985 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:25:59.270954 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:02.302908 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:02.302870 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:02.413828 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:02.413796 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:06.861053 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:06.861010 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:06.970250 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:06.970204 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:09.198384 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.198352 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:26:09.198779 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.198424 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:26:09.296138 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.296089 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j"] Jul 01 19:26:09.296392 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.296365 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" podUID="f20eebe5-813d-43e8-a118-2c3b8ee10d3e" containerName="manager" containerID="cri-o://c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677" gracePeriod=10 Jul 01 19:26:09.384927 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.384891 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:09.487358 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.487321 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:09.541947 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.541917 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:26:09.545658 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.545631 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-extensions-socket-volume\") pod \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\" (UID: \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\") " Jul 01 19:26:09.545811 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.545669 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67w97\" (UniqueName: \"kubernetes.io/projected/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-kube-api-access-67w97\") pod \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\" (UID: \"f20eebe5-813d-43e8-a118-2c3b8ee10d3e\") " Jul 01 19:26:09.546049 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.546026 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f20eebe5-813d-43e8-a118-2c3b8ee10d3e" (UID: "f20eebe5-813d-43e8-a118-2c3b8ee10d3e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:26:09.547670 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.547650 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-kube-api-access-67w97" (OuterVolumeSpecName: "kube-api-access-67w97") pod "f20eebe5-813d-43e8-a118-2c3b8ee10d3e" (UID: "f20eebe5-813d-43e8-a118-2c3b8ee10d3e"). InnerVolumeSpecName "kube-api-access-67w97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:09.646993 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.646963 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-extensions-socket-volume\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:26:09.646993 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.646989 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67w97\" (UniqueName: \"kubernetes.io/projected/f20eebe5-813d-43e8-a118-2c3b8ee10d3e-kube-api-access-67w97\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:26:09.647189 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.647016 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv"] Jul 01 19:26:09.647344 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.647331 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f20eebe5-813d-43e8-a118-2c3b8ee10d3e" containerName="manager" Jul 01 19:26:09.647379 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.647346 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f20eebe5-813d-43e8-a118-2c3b8ee10d3e" containerName="manager" Jul 01 19:26:09.647411 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.647395 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="f20eebe5-813d-43e8-a118-2c3b8ee10d3e" containerName="manager" Jul 01 19:26:09.649360 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.649344 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:09.669679 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.669652 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv"] Jul 01 19:26:09.747559 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.747468 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbm7h\" (UniqueName: \"kubernetes.io/projected/9b20dfaf-3b95-4379-9b93-edf0d6ff4d35-kube-api-access-pbm7h\") pod \"kuadrant-operator-controller-manager-86878c769f-rc7pv\" (UID: \"9b20dfaf-3b95-4379-9b93-edf0d6ff4d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:09.747559 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.747515 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b20dfaf-3b95-4379-9b93-edf0d6ff4d35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rc7pv\" (UID: \"9b20dfaf-3b95-4379-9b93-edf0d6ff4d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:09.848534 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.848494 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbm7h\" (UniqueName: \"kubernetes.io/projected/9b20dfaf-3b95-4379-9b93-edf0d6ff4d35-kube-api-access-pbm7h\") pod \"kuadrant-operator-controller-manager-86878c769f-rc7pv\" (UID: \"9b20dfaf-3b95-4379-9b93-edf0d6ff4d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:09.848742 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.848562 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b20dfaf-3b95-4379-9b93-edf0d6ff4d35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rc7pv\" (UID: \"9b20dfaf-3b95-4379-9b93-edf0d6ff4d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:09.848927 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.848907 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b20dfaf-3b95-4379-9b93-edf0d6ff4d35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rc7pv\" (UID: \"9b20dfaf-3b95-4379-9b93-edf0d6ff4d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:09.858789 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.858758 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbm7h\" (UniqueName: \"kubernetes.io/projected/9b20dfaf-3b95-4379-9b93-edf0d6ff4d35-kube-api-access-pbm7h\") pod \"kuadrant-operator-controller-manager-86878c769f-rc7pv\" (UID: \"9b20dfaf-3b95-4379-9b93-edf0d6ff4d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:09.959414 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:09.959364 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:10.130406 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.130382 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv"] Jul 01 19:26:10.132490 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:26:10.132458 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b20dfaf_3b95_4379_9b93_edf0d6ff4d35.slice/crio-04446309430e04b6d468ffdec1b9ec9839fe958f2f03ebd02d8525bbedf6ac94 WatchSource:0}: Error finding container 04446309430e04b6d468ffdec1b9ec9839fe958f2f03ebd02d8525bbedf6ac94: Status 404 returned error can't find the container with id 04446309430e04b6d468ffdec1b9ec9839fe958f2f03ebd02d8525bbedf6ac94 Jul 01 19:26:10.248847 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.248811 2551 generic.go:356] "Generic (PLEG): container finished" podID="f20eebe5-813d-43e8-a118-2c3b8ee10d3e" containerID="c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677" exitCode=0 Jul 01 19:26:10.249292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.248858 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" Jul 01 19:26:10.249292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.248906 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" event={"ID":"f20eebe5-813d-43e8-a118-2c3b8ee10d3e","Type":"ContainerDied","Data":"c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677"} Jul 01 19:26:10.249292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.248970 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j" event={"ID":"f20eebe5-813d-43e8-a118-2c3b8ee10d3e","Type":"ContainerDied","Data":"efb01c225287a2a607a73b9ae7a246a60c5892357af542cd4336fa9f4867e6f2"} Jul 01 19:26:10.249292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.249002 2551 scope.go:117] "RemoveContainer" containerID="c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677" Jul 01 19:26:10.250674 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.250643 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" event={"ID":"9b20dfaf-3b95-4379-9b93-edf0d6ff4d35","Type":"ContainerStarted","Data":"6ab210b855410021520c1544e679c9b2e03ae3af3bdbed9bcbd406381caa753c"} Jul 01 19:26:10.250792 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.250681 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" event={"ID":"9b20dfaf-3b95-4379-9b93-edf0d6ff4d35","Type":"ContainerStarted","Data":"04446309430e04b6d468ffdec1b9ec9839fe958f2f03ebd02d8525bbedf6ac94"} Jul 01 19:26:10.250792 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.250740 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:10.259202 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.259184 2551 scope.go:117] "RemoveContainer" containerID="c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677" Jul 01 19:26:10.259469 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:26:10.259449 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677\": container with ID starting with c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677 not found: ID does not exist" containerID="c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677" Jul 01 19:26:10.259516 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.259480 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677"} err="failed to get container status \"c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677\": rpc error: code = NotFound desc = could not find container \"c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677\": container with ID starting with c288eb8b472f1fd8fd5bdcea188d78094a99092c1816caf2f786e4259d0ef677 not found: ID does not exist" Jul 01 19:26:10.279253 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.279204 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" podStartSLOduration=1.279188682 podStartE2EDuration="1.279188682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:10.27720153 +0000 UTC m=+469.457533139" watchObservedRunningTime="2026-07-01 19:26:10.279188682 +0000 UTC m=+469.459520247" Jul 01 19:26:10.304569 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.304536 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j"] Jul 01 19:26:10.314319 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:10.314294 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sms4j"] Jul 01 19:26:11.255535 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:11.255499 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f20eebe5-813d-43e8-a118-2c3b8ee10d3e" path="/var/lib/kubelet/pods/f20eebe5-813d-43e8-a118-2c3b8ee10d3e/volumes" Jul 01 19:26:12.822589 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:12.822547 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:21.258983 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.258950 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rc7pv" Jul 01 19:26:21.313922 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.313888 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c"] Jul 01 19:26:21.314134 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.314098 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" podUID="2e338f6d-8553-4807-8561-3bbd625dd2d9" containerName="manager" containerID="cri-o://cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932" gracePeriod=10 Jul 01 19:26:21.572170 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.572144 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:26:21.637224 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.637185 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e338f6d-8553-4807-8561-3bbd625dd2d9-extensions-socket-volume\") pod \"2e338f6d-8553-4807-8561-3bbd625dd2d9\" (UID: \"2e338f6d-8553-4807-8561-3bbd625dd2d9\") " Jul 01 19:26:21.637420 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.637241 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x99rs\" (UniqueName: \"kubernetes.io/projected/2e338f6d-8553-4807-8561-3bbd625dd2d9-kube-api-access-x99rs\") pod \"2e338f6d-8553-4807-8561-3bbd625dd2d9\" (UID: \"2e338f6d-8553-4807-8561-3bbd625dd2d9\") " Jul 01 19:26:21.637535 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.637513 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e338f6d-8553-4807-8561-3bbd625dd2d9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2e338f6d-8553-4807-8561-3bbd625dd2d9" (UID: "2e338f6d-8553-4807-8561-3bbd625dd2d9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:26:21.639244 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.639222 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e338f6d-8553-4807-8561-3bbd625dd2d9-kube-api-access-x99rs" (OuterVolumeSpecName: "kube-api-access-x99rs") pod "2e338f6d-8553-4807-8561-3bbd625dd2d9" (UID: "2e338f6d-8553-4807-8561-3bbd625dd2d9"). InnerVolumeSpecName "kube-api-access-x99rs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:21.738518 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.738476 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e338f6d-8553-4807-8561-3bbd625dd2d9-extensions-socket-volume\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:26:21.738518 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:21.738515 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x99rs\" (UniqueName: \"kubernetes.io/projected/2e338f6d-8553-4807-8561-3bbd625dd2d9-kube-api-access-x99rs\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:26:22.310312 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:22.310275 2551 generic.go:356] "Generic (PLEG): container finished" podID="2e338f6d-8553-4807-8561-3bbd625dd2d9" containerID="cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932" exitCode=0 Jul 01 19:26:22.310727 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:22.310329 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" Jul 01 19:26:22.310727 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:22.310360 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" event={"ID":"2e338f6d-8553-4807-8561-3bbd625dd2d9","Type":"ContainerDied","Data":"cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932"} Jul 01 19:26:22.310727 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:22.310418 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c" event={"ID":"2e338f6d-8553-4807-8561-3bbd625dd2d9","Type":"ContainerDied","Data":"aa1b77e6cfc87e4cd5e2f5dabfd8bca2156110dbfae5075a12b494d13e6200cc"} Jul 01 19:26:22.310727 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:22.310441 2551 scope.go:117] "RemoveContainer" containerID="cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932" Jul 01 19:26:22.319515 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:22.319493 2551 scope.go:117] "RemoveContainer" containerID="cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932" Jul 01 19:26:22.319794 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:26:22.319775 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932\": container with ID starting with cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932 not found: ID does not exist" containerID="cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932" Jul 01 19:26:22.319868 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:22.319802 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932"} err="failed to get container status \"cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932\": rpc error: code = NotFound desc = could not find container \"cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932\": container with ID starting with cef5f0e0aff9bbe1c9eec36bc23d5e363f15d5c105a05c6faeaccb42e075e932 not found: ID does not exist" Jul 01 19:26:22.335674 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:22.335649 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c"] Jul 01 19:26:22.338997 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:22.338977 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xpc2c"] Jul 01 19:26:23.254606 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:23.254570 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e338f6d-8553-4807-8561-3bbd625dd2d9" path="/var/lib/kubelet/pods/2e338f6d-8553-4807-8561-3bbd625dd2d9/volumes" Jul 01 19:26:25.892649 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:25.892603 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:26.284911 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:26.284819 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:39.089160 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.089126 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rjjgt"] Jul 01 19:26:39.089636 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.089450 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e338f6d-8553-4807-8561-3bbd625dd2d9" containerName="manager" Jul 01 19:26:39.089636 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.089462 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e338f6d-8553-4807-8561-3bbd625dd2d9" containerName="manager" Jul 01 19:26:39.089636 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.089513 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e338f6d-8553-4807-8561-3bbd625dd2d9" containerName="manager" Jul 01 19:26:39.091252 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.091214 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:39.093603 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.093586 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:39.096165 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.096139 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 19:26:39.096286 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.096185 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j8mtr\"" Jul 01 19:26:39.102219 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.102196 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rjjgt"] Jul 01 19:26:39.164376 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.164343 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m9g6\" (UniqueName: \"kubernetes.io/projected/f2128238-76b3-4f6f-9317-c80d1b89e15c-kube-api-access-9m9g6\") pod \"limitador-limitador-64c94fd64f-rjjgt\" (UID: \"f2128238-76b3-4f6f-9317-c80d1b89e15c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:39.164376 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.164383 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f2128238-76b3-4f6f-9317-c80d1b89e15c-config-file\") pod \"limitador-limitador-64c94fd64f-rjjgt\" (UID: \"f2128238-76b3-4f6f-9317-c80d1b89e15c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:39.181199 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.181166 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rjjgt"] Jul 01 19:26:39.203898 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.203862 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:39.265826 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.265786 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m9g6\" (UniqueName: \"kubernetes.io/projected/f2128238-76b3-4f6f-9317-c80d1b89e15c-kube-api-access-9m9g6\") pod \"limitador-limitador-64c94fd64f-rjjgt\" (UID: \"f2128238-76b3-4f6f-9317-c80d1b89e15c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:39.265826 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.265827 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f2128238-76b3-4f6f-9317-c80d1b89e15c-config-file\") pod \"limitador-limitador-64c94fd64f-rjjgt\" (UID: \"f2128238-76b3-4f6f-9317-c80d1b89e15c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:39.266480 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.266457 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f2128238-76b3-4f6f-9317-c80d1b89e15c-config-file\") pod \"limitador-limitador-64c94fd64f-rjjgt\" (UID: \"f2128238-76b3-4f6f-9317-c80d1b89e15c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:39.274245 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.274217 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m9g6\" (UniqueName: \"kubernetes.io/projected/f2128238-76b3-4f6f-9317-c80d1b89e15c-kube-api-access-9m9g6\") pod \"limitador-limitador-64c94fd64f-rjjgt\" (UID: \"f2128238-76b3-4f6f-9317-c80d1b89e15c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:39.275335 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.275298 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:39.404970 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.404939 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:39.545227 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.545155 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rjjgt"] Jul 01 19:26:39.547589 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:26:39.547561 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2128238_76b3_4f6f_9317_c80d1b89e15c.slice/crio-e6cebcf9b1dd9b02179912a79c8b151b819bf3501b4c53cbe685a70803a4e87a WatchSource:0}: Error finding container e6cebcf9b1dd9b02179912a79c8b151b819bf3501b4c53cbe685a70803a4e87a: Status 404 returned error can't find the container with id e6cebcf9b1dd9b02179912a79c8b151b819bf3501b4c53cbe685a70803a4e87a Jul 01 19:26:39.987826 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:39.987793 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:40.089948 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:40.089917 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:40.400908 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:40.400869 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" event={"ID":"f2128238-76b3-4f6f-9317-c80d1b89e15c","Type":"ContainerStarted","Data":"e6cebcf9b1dd9b02179912a79c8b151b819bf3501b4c53cbe685a70803a4e87a"} Jul 01 19:26:42.413307 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:42.413270 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" event={"ID":"f2128238-76b3-4f6f-9317-c80d1b89e15c","Type":"ContainerStarted","Data":"c79d9f34d788c4922eaaa4a71da890ac4fab8edac6f890781c324a70e6bbf753"} Jul 01 19:26:42.413733 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:42.413376 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:42.434048 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:42.433995 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" podStartSLOduration=0.725479183 podStartE2EDuration="3.433978353s" totalImagesPullingTime="2.70849917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:42.43273724 +0000 UTC m=+501.613068821" watchObservedRunningTime="2026-07-01 19:26:42.433978353 +0000 UTC m=+501.614309916" Jul 01 19:26:53.419127 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:53.419091 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:55.781958 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:55.781924 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rjjgt"] Jul 01 19:26:55.782357 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:55.782102 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" podUID="f2128238-76b3-4f6f-9317-c80d1b89e15c" containerName="limitador" containerID="cri-o://c79d9f34d788c4922eaaa4a71da890ac4fab8edac6f890781c324a70e6bbf753" gracePeriod=30 Jul 01 19:26:56.480985 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:56.480948 2551 generic.go:356] "Generic (PLEG): container finished" podID="f2128238-76b3-4f6f-9317-c80d1b89e15c" containerID="c79d9f34d788c4922eaaa4a71da890ac4fab8edac6f890781c324a70e6bbf753" exitCode=0 Jul 01 19:26:56.481151 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:56.481020 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" event={"ID":"f2128238-76b3-4f6f-9317-c80d1b89e15c","Type":"ContainerDied","Data":"c79d9f34d788c4922eaaa4a71da890ac4fab8edac6f890781c324a70e6bbf753"} Jul 01 19:26:56.727036 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:56.727004 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:56.821909 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:56.821823 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m9g6\" (UniqueName: \"kubernetes.io/projected/f2128238-76b3-4f6f-9317-c80d1b89e15c-kube-api-access-9m9g6\") pod \"f2128238-76b3-4f6f-9317-c80d1b89e15c\" (UID: \"f2128238-76b3-4f6f-9317-c80d1b89e15c\") " Jul 01 19:26:56.821909 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:56.821883 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f2128238-76b3-4f6f-9317-c80d1b89e15c-config-file\") pod \"f2128238-76b3-4f6f-9317-c80d1b89e15c\" (UID: \"f2128238-76b3-4f6f-9317-c80d1b89e15c\") " Jul 01 19:26:56.822334 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:56.822244 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2128238-76b3-4f6f-9317-c80d1b89e15c-config-file" (OuterVolumeSpecName: "config-file") pod "f2128238-76b3-4f6f-9317-c80d1b89e15c" (UID: "f2128238-76b3-4f6f-9317-c80d1b89e15c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:56.823985 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:56.823965 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2128238-76b3-4f6f-9317-c80d1b89e15c-kube-api-access-9m9g6" (OuterVolumeSpecName: "kube-api-access-9m9g6") pod "f2128238-76b3-4f6f-9317-c80d1b89e15c" (UID: "f2128238-76b3-4f6f-9317-c80d1b89e15c"). InnerVolumeSpecName "kube-api-access-9m9g6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:56.922891 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:56.922854 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m9g6\" (UniqueName: \"kubernetes.io/projected/f2128238-76b3-4f6f-9317-c80d1b89e15c-kube-api-access-9m9g6\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:26:56.922891 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:56.922884 2551 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f2128238-76b3-4f6f-9317-c80d1b89e15c-config-file\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:26:57.487232 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:57.487195 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" event={"ID":"f2128238-76b3-4f6f-9317-c80d1b89e15c","Type":"ContainerDied","Data":"e6cebcf9b1dd9b02179912a79c8b151b819bf3501b4c53cbe685a70803a4e87a"} Jul 01 19:26:57.487399 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:57.487263 2551 scope.go:117] "RemoveContainer" containerID="c79d9f34d788c4922eaaa4a71da890ac4fab8edac6f890781c324a70e6bbf753" Jul 01 19:26:57.487399 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:57.487207 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rjjgt" Jul 01 19:26:57.514054 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:57.513967 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rjjgt"] Jul 01 19:26:57.523162 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:57.523125 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rjjgt"] Jul 01 19:26:59.255181 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:26:59.255144 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2128238-76b3-4f6f-9317-c80d1b89e15c" path="/var/lib/kubelet/pods/f2128238-76b3-4f6f-9317-c80d1b89e15c/volumes" Jul 01 19:27:00.358899 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.358863 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-r65x2"] Jul 01 19:27:00.359350 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.359268 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2128238-76b3-4f6f-9317-c80d1b89e15c" containerName="limitador" Jul 01 19:27:00.359350 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.359283 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2128238-76b3-4f6f-9317-c80d1b89e15c" containerName="limitador" Jul 01 19:27:00.359350 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.359337 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2128238-76b3-4f6f-9317-c80d1b89e15c" containerName="limitador" Jul 01 19:27:00.363556 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.363532 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:00.366563 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.366545 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 01 19:27:00.377917 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.377888 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-r65x2"] Jul 01 19:27:00.451924 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.451890 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9qcz\" (UniqueName: \"kubernetes.io/projected/8a1de2b7-6b4e-491c-8834-6b004186c85a-kube-api-access-r9qcz\") pod \"postgres-69fb4594cf-r65x2\" (UID: \"8a1de2b7-6b4e-491c-8834-6b004186c85a\") " pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:00.452152 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.451988 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8a1de2b7-6b4e-491c-8834-6b004186c85a-data\") pod \"postgres-69fb4594cf-r65x2\" (UID: \"8a1de2b7-6b4e-491c-8834-6b004186c85a\") " pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:00.552456 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.552412 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qcz\" (UniqueName: \"kubernetes.io/projected/8a1de2b7-6b4e-491c-8834-6b004186c85a-kube-api-access-r9qcz\") pod \"postgres-69fb4594cf-r65x2\" (UID: \"8a1de2b7-6b4e-491c-8834-6b004186c85a\") " pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:00.552631 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.552502 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8a1de2b7-6b4e-491c-8834-6b004186c85a-data\") pod \"postgres-69fb4594cf-r65x2\" (UID: \"8a1de2b7-6b4e-491c-8834-6b004186c85a\") " pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:00.552873 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.552858 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8a1de2b7-6b4e-491c-8834-6b004186c85a-data\") pod \"postgres-69fb4594cf-r65x2\" (UID: \"8a1de2b7-6b4e-491c-8834-6b004186c85a\") " pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:00.565955 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.565928 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9qcz\" (UniqueName: \"kubernetes.io/projected/8a1de2b7-6b4e-491c-8834-6b004186c85a-kube-api-access-r9qcz\") pod \"postgres-69fb4594cf-r65x2\" (UID: \"8a1de2b7-6b4e-491c-8834-6b004186c85a\") " pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:00.571154 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.571122 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:00.673464 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.673373 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:00.823514 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:00.823385 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-r65x2"] Jul 01 19:27:00.826237 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:27:00.826209 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1de2b7_6b4e_491c_8834_6b004186c85a.slice/crio-e1713e5e6969fd767e2790d75afd95d170a00020f4926d039ff5dea2214a27a4 WatchSource:0}: Error finding container e1713e5e6969fd767e2790d75afd95d170a00020f4926d039ff5dea2214a27a4: Status 404 returned error can't find the container with id e1713e5e6969fd767e2790d75afd95d170a00020f4926d039ff5dea2214a27a4 Jul 01 19:27:01.508565 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:01.508526 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-r65x2" event={"ID":"8a1de2b7-6b4e-491c-8834-6b004186c85a","Type":"ContainerStarted","Data":"e1713e5e6969fd767e2790d75afd95d170a00020f4926d039ff5dea2214a27a4"} Jul 01 19:27:11.566116 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:11.566079 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-r65x2" event={"ID":"8a1de2b7-6b4e-491c-8834-6b004186c85a","Type":"ContainerStarted","Data":"8ed404eea197380e5b88138b5f4cdcbcb5fae952070cf900d4c576c589174db1"} Jul 01 19:27:11.566502 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:11.566193 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:11.583192 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:11.583140 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-r65x2" podStartSLOduration=1.529126122 podStartE2EDuration="11.583124495s" totalImagesPullingTime="10.053998373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:11.581775997 +0000 UTC m=+530.762107584" watchObservedRunningTime="2026-07-01 19:27:11.583124495 +0000 UTC m=+530.763456058" Jul 01 19:27:17.600422 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:17.600391 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-r65x2" Jul 01 19:27:18.136806 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:18.136760 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:18.285222 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:18.285183 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:18.422578 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:18.422486 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:19.770318 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.770285 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p"] Jul 01 19:27:19.772755 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.772735 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:19.776391 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.776366 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:27:19.776514 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.776398 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zkdrx\"" Jul 01 19:27:19.777243 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.777228 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:27:19.802836 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.802809 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p"] Jul 01 19:27:19.816084 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.816055 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:19.816240 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.816106 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:19.816240 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.816132 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n79x7\" (UniqueName: \"kubernetes.io/projected/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-kube-api-access-n79x7\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:19.917269 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.917226 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:19.917526 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.917290 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:19.917526 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.917310 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n79x7\" (UniqueName: \"kubernetes.io/projected/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-kube-api-access-n79x7\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:19.917757 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.917733 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:19.917830 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.917743 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:19.927308 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:19.927283 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n79x7\" (UniqueName: \"kubernetes.io/projected/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-kube-api-access-n79x7\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:20.082419 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:20.082322 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:20.218053 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:20.217993 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p"] Jul 01 19:27:20.220417 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:27:20.220392 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8446055f_98ac_4f5d_a1f6_dd3c8a0ab647.slice/crio-77e61f10f2196d8b7f2190f63584f3f447aba814637376248d91ba6b85e38e45 WatchSource:0}: Error finding container 77e61f10f2196d8b7f2190f63584f3f447aba814637376248d91ba6b85e38e45: Status 404 returned error can't find the container with id 77e61f10f2196d8b7f2190f63584f3f447aba814637376248d91ba6b85e38e45 Jul 01 19:27:20.608985 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:20.608951 2551 generic.go:356] "Generic (PLEG): container finished" podID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerID="9fd2297961d2736534d1026165cec6d7909fddaf1d85714ec02717dd4381bd81" exitCode=0 Jul 01 19:27:20.609159 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:20.609004 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" event={"ID":"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647","Type":"ContainerDied","Data":"9fd2297961d2736534d1026165cec6d7909fddaf1d85714ec02717dd4381bd81"} Jul 01 19:27:20.609159 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:20.609039 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" event={"ID":"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647","Type":"ContainerStarted","Data":"77e61f10f2196d8b7f2190f63584f3f447aba814637376248d91ba6b85e38e45"} Jul 01 19:27:21.615927 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:21.615895 2551 generic.go:356] "Generic (PLEG): container finished" podID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerID="2299e21dcb8a32fb01059a9ddfc096332349632872b2ab173f95b3ec36dbb016" exitCode=0 Jul 01 19:27:21.616295 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:21.615967 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" event={"ID":"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647","Type":"ContainerDied","Data":"2299e21dcb8a32fb01059a9ddfc096332349632872b2ab173f95b3ec36dbb016"} Jul 01 19:27:22.623051 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:22.623014 2551 generic.go:356] "Generic (PLEG): container finished" podID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerID="551aa8750835bce29ce193bf00493b29be1d32aeae636ec0107423c06db3e63f" exitCode=0 Jul 01 19:27:22.623504 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:22.623069 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" event={"ID":"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647","Type":"ContainerDied","Data":"551aa8750835bce29ce193bf00493b29be1d32aeae636ec0107423c06db3e63f"} Jul 01 19:27:23.762814 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.762787 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:23.842926 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.842887 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n79x7\" (UniqueName: \"kubernetes.io/projected/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-kube-api-access-n79x7\") pod \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " Jul 01 19:27:23.843098 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.842949 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-util\") pod \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " Jul 01 19:27:23.843098 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.843058 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-bundle\") pod \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\" (UID: \"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647\") " Jul 01 19:27:23.843597 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.843561 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-bundle" (OuterVolumeSpecName: "bundle") pod "8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" (UID: "8446055f-98ac-4f5d-a1f6-dd3c8a0ab647"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:27:23.845099 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.845073 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-kube-api-access-n79x7" (OuterVolumeSpecName: "kube-api-access-n79x7") pod "8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" (UID: "8446055f-98ac-4f5d-a1f6-dd3c8a0ab647"). InnerVolumeSpecName "kube-api-access-n79x7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:27:23.848906 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.848873 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-util" (OuterVolumeSpecName: "util") pod "8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" (UID: "8446055f-98ac-4f5d-a1f6-dd3c8a0ab647"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:27:23.943718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.943594 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n79x7\" (UniqueName: \"kubernetes.io/projected/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-kube-api-access-n79x7\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:27:23.943718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.943626 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-util\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:27:23.943718 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:23.943636 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8446055f-98ac-4f5d-a1f6-dd3c8a0ab647-bundle\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:27:24.639735 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:24.639706 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" Jul 01 19:27:24.639735 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:24.639719 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8gnm7p" event={"ID":"8446055f-98ac-4f5d-a1f6-dd3c8a0ab647","Type":"ContainerDied","Data":"77e61f10f2196d8b7f2190f63584f3f447aba814637376248d91ba6b85e38e45"} Jul 01 19:27:24.639937 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:24.639800 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77e61f10f2196d8b7f2190f63584f3f447aba814637376248d91ba6b85e38e45" Jul 01 19:27:28.962991 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:28.962961 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:43.566780 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.566737 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:43.663404 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.663365 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:43.932456 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.932426 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:27:43.932753 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.932740 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerName="extract" Jul 01 19:27:43.932807 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.932755 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerName="extract" Jul 01 19:27:43.932807 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.932770 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerName="pull" Jul 01 19:27:43.932807 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.932775 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerName="pull" Jul 01 19:27:43.932807 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.932786 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerName="util" Jul 01 19:27:43.932807 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.932792 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerName="util" Jul 01 19:27:43.932956 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.932840 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="8446055f-98ac-4f5d-a1f6-dd3c8a0ab647" containerName="extract" Jul 01 19:27:43.934990 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.934974 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:27:43.937658 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.937622 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 19:27:43.937658 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.937622 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 19:27:43.937843 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.937657 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 19:27:43.938562 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.938543 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2f4tn\"" Jul 01 19:27:43.945857 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.945835 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:27:43.985073 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:43.985032 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm9k9\" (UniqueName: \"kubernetes.io/projected/133d98de-c6fd-4fdb-aca0-97d60529f9c7-kube-api-access-rm9k9\") pod \"maas-keycloak-0\" (UID: \"133d98de-c6fd-4fdb-aca0-97d60529f9c7\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:27:44.086028 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:44.085986 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm9k9\" (UniqueName: \"kubernetes.io/projected/133d98de-c6fd-4fdb-aca0-97d60529f9c7-kube-api-access-rm9k9\") pod \"maas-keycloak-0\" (UID: \"133d98de-c6fd-4fdb-aca0-97d60529f9c7\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:27:44.095656 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:44.095625 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm9k9\" (UniqueName: \"kubernetes.io/projected/133d98de-c6fd-4fdb-aca0-97d60529f9c7-kube-api-access-rm9k9\") pod \"maas-keycloak-0\" (UID: \"133d98de-c6fd-4fdb-aca0-97d60529f9c7\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:27:44.245892 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:44.245796 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:27:44.381289 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:44.381262 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:27:44.382860 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:27:44.382830 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133d98de_c6fd_4fdb_aca0_97d60529f9c7.slice/crio-ad5285b187b135443a561f43c4873d566d9ba484bb5fd9b0ebb468afcac99341 WatchSource:0}: Error finding container ad5285b187b135443a561f43c4873d566d9ba484bb5fd9b0ebb468afcac99341: Status 404 returned error can't find the container with id ad5285b187b135443a561f43c4873d566d9ba484bb5fd9b0ebb468afcac99341 Jul 01 19:27:44.738968 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:44.738924 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"133d98de-c6fd-4fdb-aca0-97d60529f9c7","Type":"ContainerStarted","Data":"ad5285b187b135443a561f43c4873d566d9ba484bb5fd9b0ebb468afcac99341"} Jul 01 19:27:49.769227 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:49.769165 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"133d98de-c6fd-4fdb-aca0-97d60529f9c7","Type":"ContainerStarted","Data":"d5d4f77db92a5d761144e0bc8c6528fca4bc7b8ec912cb334399afdef005ef37"} Jul 01 19:27:49.816480 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:49.816414 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.9056550589999999 podStartE2EDuration="6.816390446s" totalImagesPullingTime="4.910735387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:49.81570776 +0000 UTC m=+568.996039346" watchObservedRunningTime="2026-07-01 19:27:49.816390446 +0000 UTC m=+568.996722047" Jul 01 19:27:50.246484 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:50.246446 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 19:27:50.248617 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:50.248580 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:27:51.247007 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:51.246911 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:27:52.246640 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:52.246589 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:27:53.246756 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:53.246664 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:27:54.246517 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:54.246402 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 19:27:54.246869 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:54.246831 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:27:55.246794 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:55.246748 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:27:56.247317 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:56.247259 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:27:57.246478 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:57.246421 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:27:58.247088 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:58.247042 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:27:59.246737 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:27:59.246676 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:28:00.247137 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:00.247088 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:28:01.247071 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:01.247022 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:28:02.246462 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:02.246407 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jul 01 19:28:03.377259 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:03.377205 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 19:28:03.395535 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:03.395474 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:28:13.384768 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:13.384733 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 19:28:14.049108 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:14.049069 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:14.429244 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:14.429215 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:20.500043 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.499997 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:20.557223 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.557187 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-679f59df4f-7m59l"] Jul 01 19:28:20.562545 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.562521 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:20.566173 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.566150 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pq8zz\"" Jul 01 19:28:20.566309 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.566196 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 19:28:20.566634 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.566613 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 19:28:20.580868 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.580824 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679f59df4f-7m59l"] Jul 01 19:28:20.655127 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.655090 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:20.715193 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.715155 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-webhook-cert\") pod \"maas-controller-679f59df4f-7m59l\" (UID: \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\") " pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:20.715372 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.715198 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt8lj\" (UniqueName: \"kubernetes.io/projected/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-kube-api-access-pt8lj\") pod \"maas-controller-679f59df4f-7m59l\" (UID: \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\") " pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:20.771450 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.771353 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:20.772210 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.772186 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c9df66cbd-cx466"] Jul 01 19:28:20.778105 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.778081 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:20.803994 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.803962 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9df66cbd-cx466"] Jul 01 19:28:20.816724 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.816665 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-webhook-cert\") pod \"maas-controller-679f59df4f-7m59l\" (UID: \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\") " pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:20.816886 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.816730 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt8lj\" (UniqueName: \"kubernetes.io/projected/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-kube-api-access-pt8lj\") pod \"maas-controller-679f59df4f-7m59l\" (UID: \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\") " pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:20.819335 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.819308 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-webhook-cert\") pod \"maas-controller-679f59df4f-7m59l\" (UID: \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\") " pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:20.852485 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.852456 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt8lj\" (UniqueName: \"kubernetes.io/projected/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-kube-api-access-pt8lj\") pod \"maas-controller-679f59df4f-7m59l\" (UID: \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\") " pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:20.873335 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.873298 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:20.917825 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.917784 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ece8464a-a7c9-4670-927f-5a57e3fd9f24-webhook-cert\") pod \"maas-controller-7c9df66cbd-cx466\" (UID: \"ece8464a-a7c9-4670-927f-5a57e3fd9f24\") " pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:20.918001 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.917929 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6st7\" (UniqueName: \"kubernetes.io/projected/ece8464a-a7c9-4670-927f-5a57e3fd9f24-kube-api-access-n6st7\") pod \"maas-controller-7c9df66cbd-cx466\" (UID: \"ece8464a-a7c9-4670-927f-5a57e3fd9f24\") " pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:20.927942 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:20.927901 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:21.019350 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.019314 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6st7\" (UniqueName: \"kubernetes.io/projected/ece8464a-a7c9-4670-927f-5a57e3fd9f24-kube-api-access-n6st7\") pod \"maas-controller-7c9df66cbd-cx466\" (UID: \"ece8464a-a7c9-4670-927f-5a57e3fd9f24\") " pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:21.019562 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.019393 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ece8464a-a7c9-4670-927f-5a57e3fd9f24-webhook-cert\") pod \"maas-controller-7c9df66cbd-cx466\" (UID: \"ece8464a-a7c9-4670-927f-5a57e3fd9f24\") " pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:21.021490 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.021435 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679f59df4f-7m59l"] Jul 01 19:28:21.021925 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.021906 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ece8464a-a7c9-4670-927f-5a57e3fd9f24-webhook-cert\") pod \"maas-controller-7c9df66cbd-cx466\" (UID: \"ece8464a-a7c9-4670-927f-5a57e3fd9f24\") " pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:21.023150 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:28:21.023130 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b83831b_bd31_4379_b2bf_bafe5d1f1d24.slice/crio-70066000dfca48ec78c728f0539dfda561bd9d7ba9d22baf9f56032e158fc735 WatchSource:0}: Error finding container 70066000dfca48ec78c728f0539dfda561bd9d7ba9d22baf9f56032e158fc735: Status 404 returned error can't find the container with id 70066000dfca48ec78c728f0539dfda561bd9d7ba9d22baf9f56032e158fc735 Jul 01 19:28:21.028026 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.028004 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6st7\" (UniqueName: \"kubernetes.io/projected/ece8464a-a7c9-4670-927f-5a57e3fd9f24-kube-api-access-n6st7\") pod \"maas-controller-7c9df66cbd-cx466\" (UID: \"ece8464a-a7c9-4670-927f-5a57e3fd9f24\") " pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:21.088940 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.088909 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:21.246933 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.246901 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:28:21.249517 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.249493 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:28:21.267191 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.267167 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9df66cbd-cx466"] Jul 01 19:28:21.269519 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:28:21.269494 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece8464a_a7c9_4670_927f_5a57e3fd9f24.slice/crio-5cc2af2eb431f3198195415da8ab15766ca39006f9291b78e08e19e1a7fc716a WatchSource:0}: Error finding container 5cc2af2eb431f3198195415da8ab15766ca39006f9291b78e08e19e1a7fc716a: Status 404 returned error can't find the container with id 5cc2af2eb431f3198195415da8ab15766ca39006f9291b78e08e19e1a7fc716a Jul 01 19:28:21.975707 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.975652 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9df66cbd-cx466" event={"ID":"ece8464a-a7c9-4670-927f-5a57e3fd9f24","Type":"ContainerStarted","Data":"5cc2af2eb431f3198195415da8ab15766ca39006f9291b78e08e19e1a7fc716a"} Jul 01 19:28:21.977309 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:21.977249 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679f59df4f-7m59l" event={"ID":"0b83831b-bd31-4379-b2bf-bafe5d1f1d24","Type":"ContainerStarted","Data":"70066000dfca48ec78c728f0539dfda561bd9d7ba9d22baf9f56032e158fc735"} Jul 01 19:28:23.973891 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:23.973869 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 19:28:24.262535 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:24.262432 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:24.354532 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:24.354478 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:24.994612 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:24.994574 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9df66cbd-cx466" event={"ID":"ece8464a-a7c9-4670-927f-5a57e3fd9f24","Type":"ContainerStarted","Data":"80b0503f727f033cc52cb20e88d77744443d9b9eff17dd338087b581f17478a0"} Jul 01 19:28:24.995114 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:24.994706 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:24.996080 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:24.996053 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679f59df4f-7m59l" event={"ID":"0b83831b-bd31-4379-b2bf-bafe5d1f1d24","Type":"ContainerStarted","Data":"4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37"} Jul 01 19:28:24.996201 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:24.996181 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:25.018310 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:25.018261 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c9df66cbd-cx466" podStartSLOduration=2.318004947 podStartE2EDuration="5.01824577s" totalImagesPullingTime="2.700240823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:28:25.016323917 +0000 UTC m=+604.196655518" watchObservedRunningTime="2026-07-01 19:28:25.01824577 +0000 UTC m=+604.198577334" Jul 01 19:28:36.010256 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.010223 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:36.011578 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.010472 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c9df66cbd-cx466" Jul 01 19:28:36.050707 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.050638 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-679f59df4f-7m59l" podStartSLOduration=13.099544457 podStartE2EDuration="16.050616389s" totalImagesPullingTime="2.951071932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:28:25.054514923 +0000 UTC m=+604.234846512" watchObservedRunningTime="2026-07-01 19:28:36.050616389 +0000 UTC m=+615.230947953" Jul 01 19:28:36.095623 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.095587 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-679f59df4f-7m59l"] Jul 01 19:28:36.095941 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.095914 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-679f59df4f-7m59l" podUID="0b83831b-bd31-4379-b2bf-bafe5d1f1d24" containerName="manager" containerID="cri-o://4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37" gracePeriod=30 Jul 01 19:28:36.342189 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.342162 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:36.343220 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.343193 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt8lj\" (UniqueName: \"kubernetes.io/projected/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-kube-api-access-pt8lj\") pod \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\" (UID: \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\") " Jul 01 19:28:36.345258 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.345234 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-kube-api-access-pt8lj" (OuterVolumeSpecName: "kube-api-access-pt8lj") pod "0b83831b-bd31-4379-b2bf-bafe5d1f1d24" (UID: "0b83831b-bd31-4379-b2bf-bafe5d1f1d24"). InnerVolumeSpecName "kube-api-access-pt8lj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:28:36.443950 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.443909 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-webhook-cert\") pod \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\" (UID: \"0b83831b-bd31-4379-b2bf-bafe5d1f1d24\") " Jul 01 19:28:36.444147 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.444059 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt8lj\" (UniqueName: \"kubernetes.io/projected/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-kube-api-access-pt8lj\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:28:36.445974 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.445947 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0b83831b-bd31-4379-b2bf-bafe5d1f1d24" (UID: "0b83831b-bd31-4379-b2bf-bafe5d1f1d24"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:28:36.545309 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:36.545222 2551 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b83831b-bd31-4379-b2bf-bafe5d1f1d24-webhook-cert\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:28:37.058671 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.058631 2551 generic.go:356] "Generic (PLEG): container finished" podID="0b83831b-bd31-4379-b2bf-bafe5d1f1d24" containerID="4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37" exitCode=0 Jul 01 19:28:37.058671 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.058675 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679f59df4f-7m59l" Jul 01 19:28:37.059168 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.058713 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679f59df4f-7m59l" event={"ID":"0b83831b-bd31-4379-b2bf-bafe5d1f1d24","Type":"ContainerDied","Data":"4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37"} Jul 01 19:28:37.059168 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.058789 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679f59df4f-7m59l" event={"ID":"0b83831b-bd31-4379-b2bf-bafe5d1f1d24","Type":"ContainerDied","Data":"70066000dfca48ec78c728f0539dfda561bd9d7ba9d22baf9f56032e158fc735"} Jul 01 19:28:37.059168 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.058813 2551 scope.go:117] "RemoveContainer" containerID="4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37" Jul 01 19:28:37.068394 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.068373 2551 scope.go:117] "RemoveContainer" containerID="4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37" Jul 01 19:28:37.068677 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:28:37.068654 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37\": container with ID starting with 4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37 not found: ID does not exist" containerID="4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37" Jul 01 19:28:37.068794 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.068684 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37"} err="failed to get container status \"4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37\": rpc error: code = NotFound desc = could not find container \"4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37\": container with ID starting with 4e7e847101b7f6bcd35ccadcae704a61a5655f7ed1de5e73895edd3fd7044b37 not found: ID does not exist" Jul 01 19:28:37.080382 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.080357 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-679f59df4f-7m59l"] Jul 01 19:28:37.084732 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.084678 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-679f59df4f-7m59l"] Jul 01 19:28:37.255048 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:37.255017 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b83831b-bd31-4379-b2bf-bafe5d1f1d24" path="/var/lib/kubelet/pods/0b83831b-bd31-4379-b2bf-bafe5d1f1d24/volumes" Jul 01 19:28:56.897064 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:56.896973 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:57.372568 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.372534 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-b4c85f9dd-fphc8"] Jul 01 19:28:57.373050 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.373015 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b83831b-bd31-4379-b2bf-bafe5d1f1d24" containerName="manager" Jul 01 19:28:57.373050 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.373040 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b83831b-bd31-4379-b2bf-bafe5d1f1d24" containerName="manager" Jul 01 19:28:57.373257 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.373136 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b83831b-bd31-4379-b2bf-bafe5d1f1d24" containerName="manager" Jul 01 19:28:57.377604 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.377585 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:57.381248 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.381228 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 01 19:28:57.381383 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.381363 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bf2mf\"" Jul 01 19:28:57.391716 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.391681 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-b4c85f9dd-fphc8"] Jul 01 19:28:57.421791 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.421762 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38247ad3-7c9b-4d74-827b-18b359116d38-openshift-service-ca\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:57.421791 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.421796 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38247ad3-7c9b-4d74-827b-18b359116d38-maas-api-tls\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:57.421995 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.421878 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9sfn\" (UniqueName: \"kubernetes.io/projected/38247ad3-7c9b-4d74-827b-18b359116d38-kube-api-access-g9sfn\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:57.522289 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.522250 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38247ad3-7c9b-4d74-827b-18b359116d38-openshift-service-ca\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:57.522289 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.522288 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38247ad3-7c9b-4d74-827b-18b359116d38-maas-api-tls\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:57.522505 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.522350 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9sfn\" (UniqueName: \"kubernetes.io/projected/38247ad3-7c9b-4d74-827b-18b359116d38-kube-api-access-g9sfn\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:57.522505 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:28:57.522470 2551 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 01 19:28:57.522580 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:28:57.522543 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38247ad3-7c9b-4d74-827b-18b359116d38-maas-api-tls podName:38247ad3-7c9b-4d74-827b-18b359116d38 nodeName:}" failed. No retries permitted until 2026-07-01 19:28:58.02252587 +0000 UTC m=+637.202857418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38247ad3-7c9b-4d74-827b-18b359116d38-maas-api-tls") pod "maas-api-b4c85f9dd-fphc8" (UID: "38247ad3-7c9b-4d74-827b-18b359116d38") : secret "maas-api-serving-cert" not found Jul 01 19:28:57.523000 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.522982 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38247ad3-7c9b-4d74-827b-18b359116d38-openshift-service-ca\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:57.532182 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.532155 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9sfn\" (UniqueName: \"kubernetes.io/projected/38247ad3-7c9b-4d74-827b-18b359116d38-kube-api-access-g9sfn\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:57.942997 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.942960 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:57.984441 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.984410 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-4j5jr"] Jul 01 19:28:57.987176 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.987158 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:28:57.989617 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.989599 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wzcmb\"" Jul 01 19:28:57.989840 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.989827 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 19:28:57.997879 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:57.997848 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-4j5jr"] Jul 01 19:28:58.027942 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.027902 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9b89b23-e50f-4578-8117-9f0aad83bc6a-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-4j5jr\" (UID: \"c9b89b23-e50f-4578-8117-9f0aad83bc6a\") " pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:28:58.028131 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.027960 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38247ad3-7c9b-4d74-827b-18b359116d38-maas-api-tls\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:58.028131 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.028052 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr4p6\" (UniqueName: \"kubernetes.io/projected/c9b89b23-e50f-4578-8117-9f0aad83bc6a-kube-api-access-dr4p6\") pod \"payload-processing-7bbcb654f4-4j5jr\" (UID: \"c9b89b23-e50f-4578-8117-9f0aad83bc6a\") " pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:28:58.028131 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:28:58.028066 2551 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 01 19:28:58.028304 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:28:58.028145 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38247ad3-7c9b-4d74-827b-18b359116d38-maas-api-tls podName:38247ad3-7c9b-4d74-827b-18b359116d38 nodeName:}" failed. No retries permitted until 2026-07-01 19:28:59.028123116 +0000 UTC m=+638.208454673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38247ad3-7c9b-4d74-827b-18b359116d38-maas-api-tls") pod "maas-api-b4c85f9dd-fphc8" (UID: "38247ad3-7c9b-4d74-827b-18b359116d38") : secret "maas-api-serving-cert" not found Jul 01 19:28:58.053517 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.053480 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb"] Jul 01 19:28:58.056362 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.056334 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:28:58.077470 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.077436 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb"] Jul 01 19:28:58.128611 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.128564 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d672670b-3397-4a1c-a605-15802c7eb133-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-l4wnb\" (UID: \"d672670b-3397-4a1c-a605-15802c7eb133\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:28:58.128848 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.128629 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbhv8\" (UniqueName: \"kubernetes.io/projected/d672670b-3397-4a1c-a605-15802c7eb133-kube-api-access-mbhv8\") pod \"payload-pre-processing-59f49fd4f6-l4wnb\" (UID: \"d672670b-3397-4a1c-a605-15802c7eb133\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:28:58.128848 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.128676 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9b89b23-e50f-4578-8117-9f0aad83bc6a-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-4j5jr\" (UID: \"c9b89b23-e50f-4578-8117-9f0aad83bc6a\") " pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:28:58.128848 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.128739 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr4p6\" (UniqueName: \"kubernetes.io/projected/c9b89b23-e50f-4578-8117-9f0aad83bc6a-kube-api-access-dr4p6\") pod \"payload-processing-7bbcb654f4-4j5jr\" (UID: \"c9b89b23-e50f-4578-8117-9f0aad83bc6a\") " pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:28:58.129490 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.129465 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9b89b23-e50f-4578-8117-9f0aad83bc6a-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-4j5jr\" (UID: \"c9b89b23-e50f-4578-8117-9f0aad83bc6a\") " pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:28:58.137985 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.137948 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr4p6\" (UniqueName: \"kubernetes.io/projected/c9b89b23-e50f-4578-8117-9f0aad83bc6a-kube-api-access-dr4p6\") pod \"payload-processing-7bbcb654f4-4j5jr\" (UID: \"c9b89b23-e50f-4578-8117-9f0aad83bc6a\") " pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:28:58.230238 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.230141 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbhv8\" (UniqueName: \"kubernetes.io/projected/d672670b-3397-4a1c-a605-15802c7eb133-kube-api-access-mbhv8\") pod \"payload-pre-processing-59f49fd4f6-l4wnb\" (UID: \"d672670b-3397-4a1c-a605-15802c7eb133\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:28:58.230238 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.230236 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d672670b-3397-4a1c-a605-15802c7eb133-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-l4wnb\" (UID: \"d672670b-3397-4a1c-a605-15802c7eb133\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:28:58.231006 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.230982 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d672670b-3397-4a1c-a605-15802c7eb133-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-l4wnb\" (UID: \"d672670b-3397-4a1c-a605-15802c7eb133\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:28:58.238133 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.238108 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbhv8\" (UniqueName: \"kubernetes.io/projected/d672670b-3397-4a1c-a605-15802c7eb133-kube-api-access-mbhv8\") pod \"payload-pre-processing-59f49fd4f6-l4wnb\" (UID: \"d672670b-3397-4a1c-a605-15802c7eb133\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:28:58.286029 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.285988 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:58.300180 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.300150 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:28:58.368046 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.368017 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:28:58.469070 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.469037 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-4j5jr"] Jul 01 19:28:58.470266 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:28:58.470238 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b89b23_e50f_4578_8117_9f0aad83bc6a.slice/crio-058ad258521a9495211caa0f3d992ace128952e97d80b7efbd2e5eba485bfc07 WatchSource:0}: Error finding container 058ad258521a9495211caa0f3d992ace128952e97d80b7efbd2e5eba485bfc07: Status 404 returned error can't find the container with id 058ad258521a9495211caa0f3d992ace128952e97d80b7efbd2e5eba485bfc07 Jul 01 19:28:58.473063 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.473041 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:28:58.517222 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:58.517194 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb"] Jul 01 19:28:58.519139 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:28:58.519113 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd672670b_3397_4a1c_a605_15802c7eb133.slice/crio-0864c23b9ec41fe5d0133f2c1aeaa6f2c7629bb25244bfd6802381949c4e6e1b WatchSource:0}: Error finding container 0864c23b9ec41fe5d0133f2c1aeaa6f2c7629bb25244bfd6802381949c4e6e1b: Status 404 returned error can't find the container with id 0864c23b9ec41fe5d0133f2c1aeaa6f2c7629bb25244bfd6802381949c4e6e1b Jul 01 19:28:59.038836 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:59.038794 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38247ad3-7c9b-4d74-827b-18b359116d38-maas-api-tls\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:59.041337 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:59.041303 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38247ad3-7c9b-4d74-827b-18b359116d38-maas-api-tls\") pod \"maas-api-b4c85f9dd-fphc8\" (UID: \"38247ad3-7c9b-4d74-827b-18b359116d38\") " pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:59.187905 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:59.187870 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:28:59.192306 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:59.192057 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" event={"ID":"d672670b-3397-4a1c-a605-15802c7eb133","Type":"ContainerStarted","Data":"0864c23b9ec41fe5d0133f2c1aeaa6f2c7629bb25244bfd6802381949c4e6e1b"} Jul 01 19:28:59.194399 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:59.194324 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" event={"ID":"c9b89b23-e50f-4578-8117-9f0aad83bc6a","Type":"ContainerStarted","Data":"058ad258521a9495211caa0f3d992ace128952e97d80b7efbd2e5eba485bfc07"} Jul 01 19:28:59.415272 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:28:59.415239 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-b4c85f9dd-fphc8"] Jul 01 19:28:59.418084 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:28:59.418036 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38247ad3_7c9b_4d74_827b_18b359116d38.slice/crio-d1843612792ecd0d8169b10ba65b406623c7ab31cb18db4c87b5cc911373a1ae WatchSource:0}: Error finding container d1843612792ecd0d8169b10ba65b406623c7ab31cb18db4c87b5cc911373a1ae: Status 404 returned error can't find the container with id d1843612792ecd0d8169b10ba65b406623c7ab31cb18db4c87b5cc911373a1ae Jul 01 19:29:00.201750 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:00.201678 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-b4c85f9dd-fphc8" event={"ID":"38247ad3-7c9b-4d74-827b-18b359116d38","Type":"ContainerStarted","Data":"d1843612792ecd0d8169b10ba65b406623c7ab31cb18db4c87b5cc911373a1ae"} Jul 01 19:29:01.210326 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:01.210224 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" event={"ID":"d672670b-3397-4a1c-a605-15802c7eb133","Type":"ContainerStarted","Data":"cc5dfa5ab9eb63fef159035158834d2a22766d4dd058626abfa77f035e90a8cd"} Jul 01 19:29:01.210815 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:01.210351 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:29:01.211948 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:01.211908 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" event={"ID":"c9b89b23-e50f-4578-8117-9f0aad83bc6a","Type":"ContainerStarted","Data":"9502a87e0a4a36e0a0063059010042156a72a83d80d3e4bc6733872de5a7d10f"} Jul 01 19:29:01.212082 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:01.211963 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:29:01.248717 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:01.248636 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" podStartSLOduration=0.797069404 podStartE2EDuration="3.248613529s" totalImagesPullingTime="2.451544125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:01.247006222 +0000 UTC m=+640.427337789" watchObservedRunningTime="2026-07-01 19:29:01.248613529 +0000 UTC m=+640.428945095" Jul 01 19:29:01.284824 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:01.284770 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" podStartSLOduration=1.7923890999999998 podStartE2EDuration="4.28475417s" totalImagesPullingTime="2.49236507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:01.282660702 +0000 UTC m=+640.462992294" watchObservedRunningTime="2026-07-01 19:29:01.28475417 +0000 UTC m=+640.465085711" Jul 01 19:29:03.234267 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:03.234214 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-b4c85f9dd-fphc8" event={"ID":"38247ad3-7c9b-4d74-827b-18b359116d38","Type":"ContainerStarted","Data":"9d3781feb7262e3e69642fe202d0c4613eb499c29e3ce4bbe0eecaa69d317283"} Jul 01 19:29:03.234719 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:03.234324 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:29:03.256819 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:03.256759 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-b4c85f9dd-fphc8" podStartSLOduration=3.5279921 podStartE2EDuration="6.256736837s" totalImagesPullingTime="2.728744737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:03.253795919 +0000 UTC m=+642.434127511" watchObservedRunningTime="2026-07-01 19:29:03.256736837 +0000 UTC m=+642.437068402" Jul 01 19:29:09.244848 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:09.244818 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-b4c85f9dd-fphc8" Jul 01 19:29:10.819309 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:10.819276 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:29:10.819801 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:10.819478 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" containerID="cri-o://d5d4f77db92a5d761144e0bc8c6528fca4bc7b8ec912cb334399afdef005ef37" gracePeriod=30 Jul 01 19:29:12.220729 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:12.220671 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-l4wnb" Jul 01 19:29:12.221132 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:12.220789 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:29:12.283624 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:12.283594 2551 generic.go:356] "Generic (PLEG): container finished" podID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerID="d5d4f77db92a5d761144e0bc8c6528fca4bc7b8ec912cb334399afdef005ef37" exitCode=143 Jul 01 19:29:12.283807 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:12.283674 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"133d98de-c6fd-4fdb-aca0-97d60529f9c7","Type":"ContainerDied","Data":"d5d4f77db92a5d761144e0bc8c6528fca4bc7b8ec912cb334399afdef005ef37"} Jul 01 19:29:12.311950 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:12.311909 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:12.861380 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:12.861351 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:12.967602 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:12.967561 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rm9k9\" (UniqueName: \"kubernetes.io/projected/133d98de-c6fd-4fdb-aca0-97d60529f9c7-kube-api-access-rm9k9\") pod \"133d98de-c6fd-4fdb-aca0-97d60529f9c7\" (UID: \"133d98de-c6fd-4fdb-aca0-97d60529f9c7\") " Jul 01 19:29:12.969919 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:12.969888 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133d98de-c6fd-4fdb-aca0-97d60529f9c7-kube-api-access-rm9k9" (OuterVolumeSpecName: "kube-api-access-rm9k9") pod "133d98de-c6fd-4fdb-aca0-97d60529f9c7" (UID: "133d98de-c6fd-4fdb-aca0-97d60529f9c7"). InnerVolumeSpecName "kube-api-access-rm9k9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:29:13.069133 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.069048 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm9k9\" (UniqueName: \"kubernetes.io/projected/133d98de-c6fd-4fdb-aca0-97d60529f9c7-kube-api-access-rm9k9\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:29:13.289881 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.289847 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:13.289881 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.289875 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"133d98de-c6fd-4fdb-aca0-97d60529f9c7","Type":"ContainerDied","Data":"ad5285b187b135443a561f43c4873d566d9ba484bb5fd9b0ebb468afcac99341"} Jul 01 19:29:13.290359 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.289933 2551 scope.go:117] "RemoveContainer" containerID="d5d4f77db92a5d761144e0bc8c6528fca4bc7b8ec912cb334399afdef005ef37" Jul 01 19:29:13.307966 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.307933 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:29:13.314119 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.314093 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:29:13.339906 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.339837 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:29:13.340184 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.340173 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" Jul 01 19:29:13.340226 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.340187 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" Jul 01 19:29:13.340267 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.340257 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" containerName="keycloak" Jul 01 19:29:13.344515 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.344499 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:13.347241 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.347214 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 19:29:13.347375 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.347243 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 19:29:13.347375 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.347281 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2f4tn\"" Jul 01 19:29:13.347375 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.347218 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 01 19:29:13.347375 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.347248 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 19:29:13.354548 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.354525 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:29:13.472578 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.472537 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8vh9\" (UniqueName: \"kubernetes.io/projected/0aae8ef6-b88a-496b-abbf-f6e742651b85-kube-api-access-f8vh9\") pod \"maas-keycloak-0\" (UID: \"0aae8ef6-b88a-496b-abbf-f6e742651b85\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:13.472792 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.472605 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0aae8ef6-b88a-496b-abbf-f6e742651b85-test-realms\") pod \"maas-keycloak-0\" (UID: \"0aae8ef6-b88a-496b-abbf-f6e742651b85\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:13.573859 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.573818 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8vh9\" (UniqueName: \"kubernetes.io/projected/0aae8ef6-b88a-496b-abbf-f6e742651b85-kube-api-access-f8vh9\") pod \"maas-keycloak-0\" (UID: \"0aae8ef6-b88a-496b-abbf-f6e742651b85\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:13.574043 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.573894 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0aae8ef6-b88a-496b-abbf-f6e742651b85-test-realms\") pod \"maas-keycloak-0\" (UID: \"0aae8ef6-b88a-496b-abbf-f6e742651b85\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:13.574580 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.574559 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0aae8ef6-b88a-496b-abbf-f6e742651b85-test-realms\") pod \"maas-keycloak-0\" (UID: \"0aae8ef6-b88a-496b-abbf-f6e742651b85\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:13.582731 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.582703 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8vh9\" (UniqueName: \"kubernetes.io/projected/0aae8ef6-b88a-496b-abbf-f6e742651b85-kube-api-access-f8vh9\") pod \"maas-keycloak-0\" (UID: \"0aae8ef6-b88a-496b-abbf-f6e742651b85\") " pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:13.655361 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.655328 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:13.793745 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:13.793719 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 19:29:13.795891 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:29:13.795858 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aae8ef6_b88a_496b_abbf_f6e742651b85.slice/crio-c78acb3d6fee1c907f6807ede719b47cf6dc0b2d7ad704fd8a0e8396f8334929 WatchSource:0}: Error finding container c78acb3d6fee1c907f6807ede719b47cf6dc0b2d7ad704fd8a0e8396f8334929: Status 404 returned error can't find the container with id c78acb3d6fee1c907f6807ede719b47cf6dc0b2d7ad704fd8a0e8396f8334929 Jul 01 19:29:14.298620 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:14.298576 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0aae8ef6-b88a-496b-abbf-f6e742651b85","Type":"ContainerStarted","Data":"00a5511ecc674dc35f953efa88e8cd0354b8082829ed75fd12b69a5e8e1cbcb4"} Jul 01 19:29:14.299103 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:14.298646 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0aae8ef6-b88a-496b-abbf-f6e742651b85","Type":"ContainerStarted","Data":"c78acb3d6fee1c907f6807ede719b47cf6dc0b2d7ad704fd8a0e8396f8334929"} Jul 01 19:29:14.319492 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:14.319432 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.015883011 podStartE2EDuration="1.319413576s" totalImagesPullingTime="303.530565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:14.317116427 +0000 UTC m=+653.497447993" watchObservedRunningTime="2026-07-01 19:29:14.319413576 +0000 UTC m=+653.499745140" Jul 01 19:29:14.655630 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:14.655583 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:14.657404 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:14.657366 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:15.255757 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:15.255721 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133d98de-c6fd-4fdb-aca0-97d60529f9c7" path="/var/lib/kubelet/pods/133d98de-c6fd-4fdb-aca0-97d60529f9c7/volumes" Jul 01 19:29:15.656579 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:15.656536 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:16.656262 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:16.656215 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:17.656446 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:17.656371 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:18.619537 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:18.619499 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:18.656061 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:18.656012 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:18.721744 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:18.721704 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:19.656589 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:19.656541 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:20.656200 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:20.656145 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:21.656642 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:21.656583 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:22.656645 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:22.656602 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:23.012304 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:23.012205 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:23.073594 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:23.073547 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:23.656519 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:23.656474 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:23.657002 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:23.656899 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:24.656292 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:24.656227 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:25.656389 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:25.656331 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:26.656772 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:26.656727 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jul 01 19:29:27.784141 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:27.784089 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:27.801380 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:27.801097 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0aae8ef6-b88a-496b-abbf-f6e742651b85" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:29:37.790866 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:37.790806 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 19:29:51.198397 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:51.198357 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:51.301771 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:29:51.301730 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:00.138280 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:00.138233 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29715570-nvvc5"] Jul 01 19:30:00.141846 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:00.141817 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" Jul 01 19:30:00.151964 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:00.151934 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29715570-nvvc5"] Jul 01 19:30:00.311408 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:00.311366 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnzt9\" (UniqueName: \"kubernetes.io/projected/c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c-kube-api-access-gnzt9\") pod \"maas-api-key-cleanup-29715570-nvvc5\" (UID: \"c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c\") " pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" Jul 01 19:30:00.412866 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:00.412768 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnzt9\" (UniqueName: \"kubernetes.io/projected/c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c-kube-api-access-gnzt9\") pod \"maas-api-key-cleanup-29715570-nvvc5\" (UID: \"c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c\") " pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" Jul 01 19:30:00.422550 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:00.422514 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnzt9\" (UniqueName: \"kubernetes.io/projected/c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c-kube-api-access-gnzt9\") pod \"maas-api-key-cleanup-29715570-nvvc5\" (UID: \"c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c\") " pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" Jul 01 19:30:00.453412 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:00.453371 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" Jul 01 19:30:00.590611 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:00.590584 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29715570-nvvc5"] Jul 01 19:30:00.592523 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:30:00.592496 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54e5c38_4ba7_4de3_9cb0_e16aec1adf0c.slice/crio-73ccb1f143897a7ab3b60c66b030cfa687ddd8ce5c5d9c1befd08eba005ac0a2 WatchSource:0}: Error finding container 73ccb1f143897a7ab3b60c66b030cfa687ddd8ce5c5d9c1befd08eba005ac0a2: Status 404 returned error can't find the container with id 73ccb1f143897a7ab3b60c66b030cfa687ddd8ce5c5d9c1befd08eba005ac0a2 Jul 01 19:30:01.584625 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:01.584593 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" event={"ID":"c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c","Type":"ContainerStarted","Data":"73ccb1f143897a7ab3b60c66b030cfa687ddd8ce5c5d9c1befd08eba005ac0a2"} Jul 01 19:30:03.308926 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:03.308868 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:03.519131 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:03.519099 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:04.604311 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:04.604272 2551 generic.go:356] "Generic (PLEG): container finished" podID="c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c" containerID="a127c17fcd64030cb7fd8bda6f1e37a1eb43f491265680a8817ef00fac778f7e" exitCode=0 Jul 01 19:30:04.604733 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:04.604358 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" event={"ID":"c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c","Type":"ContainerDied","Data":"a127c17fcd64030cb7fd8bda6f1e37a1eb43f491265680a8817ef00fac778f7e"} Jul 01 19:30:05.742155 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:05.742127 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" Jul 01 19:30:05.863039 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:05.862954 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnzt9\" (UniqueName: \"kubernetes.io/projected/c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c-kube-api-access-gnzt9\") pod \"c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c\" (UID: \"c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c\") " Jul 01 19:30:05.865088 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:05.865058 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c-kube-api-access-gnzt9" (OuterVolumeSpecName: "kube-api-access-gnzt9") pod "c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c" (UID: "c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c"). InnerVolumeSpecName "kube-api-access-gnzt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:30:05.963885 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:05.963847 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnzt9\" (UniqueName: \"kubernetes.io/projected/c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c-kube-api-access-gnzt9\") on node \"ip-10-0-143-127.ec2.internal\" DevicePath \"\"" Jul 01 19:30:06.541466 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.541430 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx"] Jul 01 19:30:06.541821 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.541807 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c" containerName="cleanup" Jul 01 19:30:06.541874 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.541823 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c" containerName="cleanup" Jul 01 19:30:06.541910 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.541885 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c" containerName="cleanup" Jul 01 19:30:06.545226 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.545209 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.548088 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.548062 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j8gzm\"" Jul 01 19:30:06.548878 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.548862 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 01 19:30:06.549058 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.549041 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 19:30:06.549156 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.549063 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 19:30:06.559849 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.559823 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx"] Jul 01 19:30:06.592372 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.592336 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:06.618030 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.617999 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" Jul 01 19:30:06.618205 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.618042 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29715570-nvvc5" event={"ID":"c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c","Type":"ContainerDied","Data":"73ccb1f143897a7ab3b60c66b030cfa687ddd8ce5c5d9c1befd08eba005ac0a2"} Jul 01 19:30:06.618205 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.618101 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73ccb1f143897a7ab3b60c66b030cfa687ddd8ce5c5d9c1befd08eba005ac0a2" Jul 01 19:30:06.670888 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.670857 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nbhz\" (UniqueName: \"kubernetes.io/projected/cf287386-db8c-4cda-8710-40a2df78c2d8-kube-api-access-5nbhz\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.670888 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.670894 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf287386-db8c-4cda-8710-40a2df78c2d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.671118 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.670920 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf287386-db8c-4cda-8710-40a2df78c2d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.671118 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.670973 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf287386-db8c-4cda-8710-40a2df78c2d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.671118 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.671013 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf287386-db8c-4cda-8710-40a2df78c2d8-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.771781 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.771729 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nbhz\" (UniqueName: \"kubernetes.io/projected/cf287386-db8c-4cda-8710-40a2df78c2d8-kube-api-access-5nbhz\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.771781 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.771780 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf287386-db8c-4cda-8710-40a2df78c2d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.772341 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.771811 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf287386-db8c-4cda-8710-40a2df78c2d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.772341 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.771833 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf287386-db8c-4cda-8710-40a2df78c2d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.772341 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.771852 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf287386-db8c-4cda-8710-40a2df78c2d8-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.772341 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.772278 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf287386-db8c-4cda-8710-40a2df78c2d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.772341 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.772302 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf287386-db8c-4cda-8710-40a2df78c2d8-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.774181 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.774163 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf287386-db8c-4cda-8710-40a2df78c2d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.774460 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.774442 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf287386-db8c-4cda-8710-40a2df78c2d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.783322 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.783296 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nbhz\" (UniqueName: \"kubernetes.io/projected/cf287386-db8c-4cda-8710-40a2df78c2d8-kube-api-access-5nbhz\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-p2mkx\" (UID: \"cf287386-db8c-4cda-8710-40a2df78c2d8\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.856259 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.856149 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:06.996449 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:06.996364 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx"] Jul 01 19:30:06.998847 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:30:06.998816 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf287386_db8c_4cda_8710_40a2df78c2d8.slice/crio-d2fc5a45b64e59e1d53301138c9cc9c9cb44513b78c96229d9ae3a930bb78248 WatchSource:0}: Error finding container d2fc5a45b64e59e1d53301138c9cc9c9cb44513b78c96229d9ae3a930bb78248: Status 404 returned error can't find the container with id d2fc5a45b64e59e1d53301138c9cc9c9cb44513b78c96229d9ae3a930bb78248 Jul 01 19:30:07.624827 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:07.624793 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" event={"ID":"cf287386-db8c-4cda-8710-40a2df78c2d8","Type":"ContainerStarted","Data":"d2fc5a45b64e59e1d53301138c9cc9c9cb44513b78c96229d9ae3a930bb78248"} Jul 01 19:30:09.638747 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:09.638705 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" event={"ID":"cf287386-db8c-4cda-8710-40a2df78c2d8","Type":"ContainerStarted","Data":"4772233ded948d7bf063e3acf4aa0bda03de26c0cb7dc0d6c7f8fc48823648fa"} Jul 01 19:30:09.658741 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:09.658680 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" podStartSLOduration=1.345176619 podStartE2EDuration="3.658666117s" totalImagesPullingTime="2.313489498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:30:09.656160042 +0000 UTC m=+708.836491633" watchObservedRunningTime="2026-07-01 19:30:09.658666117 +0000 UTC m=+708.838997723" Jul 01 19:30:16.857257 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:16.857196 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:16.857685 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:16.857281 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:16.870050 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:16.870024 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:17.693604 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:17.693568 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-p2mkx" Jul 01 19:30:26.330564 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:26.330528 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:35.371060 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:35.371020 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:43.338035 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:43.337998 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:50.339004 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.338971 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv"] Jul 01 19:30:50.342277 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.342256 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.345490 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.345470 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 01 19:30:50.362107 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.362069 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv"] Jul 01 19:30:50.426117 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.426078 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:50.448144 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.448107 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.448319 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.448153 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.448319 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.448171 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdcdn\" (UniqueName: \"kubernetes.io/projected/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-kube-api-access-bdcdn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.448319 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.448209 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.448319 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.448236 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.548862 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.548812 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.549083 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.548897 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.549083 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.548924 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.549083 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.548943 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdcdn\" (UniqueName: \"kubernetes.io/projected/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-kube-api-access-bdcdn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.549083 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.548988 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.549319 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.549301 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.549455 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.549424 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.551281 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.551250 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.551522 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.551501 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.561241 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.561218 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdcdn\" (UniqueName: \"kubernetes.io/projected/bf0ab4af-f515-4225-9c9c-eccc61d19a1f-kube-api-access-bdcdn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv\" (UID: \"bf0ab4af-f515-4225-9c9c-eccc61d19a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.652324 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.652285 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:30:50.797284 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.797257 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv"] Jul 01 19:30:50.798937 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:30:50.798910 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0ab4af_f515_4225_9c9c_eccc61d19a1f.slice/crio-cbae5fa96e19b147c82110380ca723e7ad8ed72c8ac9097e2a83745e836eb99e WatchSource:0}: Error finding container cbae5fa96e19b147c82110380ca723e7ad8ed72c8ac9097e2a83745e836eb99e: Status 404 returned error can't find the container with id cbae5fa96e19b147c82110380ca723e7ad8ed72c8ac9097e2a83745e836eb99e Jul 01 19:30:50.853735 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:50.853677 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" event={"ID":"bf0ab4af-f515-4225-9c9c-eccc61d19a1f","Type":"ContainerStarted","Data":"cbae5fa96e19b147c82110380ca723e7ad8ed72c8ac9097e2a83745e836eb99e"} Jul 01 19:30:51.861213 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:51.861178 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" event={"ID":"bf0ab4af-f515-4225-9c9c-eccc61d19a1f","Type":"ContainerStarted","Data":"de087d0ea04a4874125fdedf226a5787530a623a1af33f0b26795250011cf4b4"} Jul 01 19:30:51.888495 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:30:51.888441 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" podStartSLOduration=1.6381603359999999 podStartE2EDuration="1.88842457s" totalImagesPullingTime="250.264234ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:30:51.885137059 +0000 UTC m=+751.065468685" watchObservedRunningTime="2026-07-01 19:30:51.88842457 +0000 UTC m=+751.068756134" Jul 01 19:31:00.653258 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:31:00.653219 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:31:00.653258 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:31:00.653285 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:31:00.666067 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:31:00.666036 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:31:00.922392 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:31:00.922301 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv" Jul 01 19:31:05.070501 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:31:05.070459 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:31:09.974432 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:31:09.974397 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:31:32.354415 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:31:32.354376 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:31:32.454734 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:31:32.454669 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:19.576132 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:19.576095 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:19.675728 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:19.675668 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:20.703861 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:20.703824 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:20.805397 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:20.805363 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:26.365228 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:26.365184 2551 generic.go:356] "Generic (PLEG): container finished" podID="c9b89b23-e50f-4578-8117-9f0aad83bc6a" containerID="9502a87e0a4a36e0a0063059010042156a72a83d80d3e4bc6733872de5a7d10f" exitCode=2 Jul 01 19:32:26.365644 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:26.365254 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" event={"ID":"c9b89b23-e50f-4578-8117-9f0aad83bc6a","Type":"ContainerDied","Data":"9502a87e0a4a36e0a0063059010042156a72a83d80d3e4bc6733872de5a7d10f"} Jul 01 19:32:26.365644 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:26.365598 2551 scope.go:117] "RemoveContainer" containerID="9502a87e0a4a36e0a0063059010042156a72a83d80d3e4bc6733872de5a7d10f" Jul 01 19:32:27.372470 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:27.372434 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" event={"ID":"c9b89b23-e50f-4578-8117-9f0aad83bc6a","Type":"ContainerStarted","Data":"3c2b5d082c40ecdeaa8ff5eb4137ae71965efcfc5034109ea210e52da50d6797"} Jul 01 19:32:27.372922 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:27.372636 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:32:38.380527 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:38.380488 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:32:59.540737 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:59.540665 2551 generic.go:356] "Generic (PLEG): container finished" podID="c9b89b23-e50f-4578-8117-9f0aad83bc6a" containerID="3c2b5d082c40ecdeaa8ff5eb4137ae71965efcfc5034109ea210e52da50d6797" exitCode=2 Jul 01 19:32:59.541191 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:59.540749 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" event={"ID":"c9b89b23-e50f-4578-8117-9f0aad83bc6a","Type":"ContainerDied","Data":"3c2b5d082c40ecdeaa8ff5eb4137ae71965efcfc5034109ea210e52da50d6797"} Jul 01 19:32:59.541191 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:59.540816 2551 scope.go:117] "RemoveContainer" containerID="9502a87e0a4a36e0a0063059010042156a72a83d80d3e4bc6733872de5a7d10f" Jul 01 19:32:59.541191 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:32:59.541127 2551 scope.go:117] "RemoveContainer" containerID="3c2b5d082c40ecdeaa8ff5eb4137ae71965efcfc5034109ea210e52da50d6797" Jul 01 19:32:59.541363 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:32:59.541338 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-4j5jr_openshift-ingress(c9b89b23-e50f-4578-8117-9f0aad83bc6a)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" podUID="c9b89b23-e50f-4578-8117-9f0aad83bc6a" Jul 01 19:33:03.627018 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:03.626980 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-59994cc79f-f5zsd_3fc460b5-4602-4e81-9e85-d1fecb112d2c/nginx/0.log" Jul 01 19:33:04.023146 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:04.023062 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-b4c85f9dd-fphc8_38247ad3-7c9b-4d74-827b-18b359116d38/maas-api/0.log" Jul 01 19:33:04.126978 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:04.126944 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29715570-nvvc5_c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c/cleanup/0.log" Jul 01 19:33:04.258699 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:04.258670 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c9df66cbd-cx466_ece8464a-a7c9-4670-927f-5a57e3fd9f24/manager/0.log" Jul 01 19:33:04.740142 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:04.740112 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-bdptl_b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea/copy-manifests/0.log" Jul 01 19:33:04.759323 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:04.759290 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-bdptl_b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea/manager/0.log" Jul 01 19:33:04.990970 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:04.990888 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-r65x2_8a1de2b7-6b4e-491c-8834-6b004186c85a/postgres/0.log" Jul 01 19:33:05.748416 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:05.748387 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg_3d3d05cc-9bed-4c1f-9b71-24069579dd83/extract/0.log" Jul 01 19:33:05.755040 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:05.755019 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg_3d3d05cc-9bed-4c1f-9b71-24069579dd83/util/0.log" Jul 01 19:33:05.761845 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:05.761820 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg_3d3d05cc-9bed-4c1f-9b71-24069579dd83/pull/0.log" Jul 01 19:33:05.871814 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:05.871776 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2_61598140-40e2-49e4-85f5-cb42b5a0d8e2/util/0.log" Jul 01 19:33:05.878430 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:05.878399 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2_61598140-40e2-49e4-85f5-cb42b5a0d8e2/pull/0.log" Jul 01 19:33:05.884926 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:05.884903 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2_61598140-40e2-49e4-85f5-cb42b5a0d8e2/extract/0.log" Jul 01 19:33:05.994076 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:05.994039 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q_9829d4b0-1b67-4c23-9a82-8fcc23159d40/util/0.log" Jul 01 19:33:06.001294 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:06.001211 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q_9829d4b0-1b67-4c23-9a82-8fcc23159d40/pull/0.log" Jul 01 19:33:06.008174 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:06.008149 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q_9829d4b0-1b67-4c23-9a82-8fcc23159d40/extract/0.log" Jul 01 19:33:06.115769 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:06.115726 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl_9303db76-3f27-404b-948a-984239b30891/util/0.log" Jul 01 19:33:06.122507 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:06.122478 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl_9303db76-3f27-404b-948a-984239b30891/pull/0.log" Jul 01 19:33:06.129095 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:06.129073 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl_9303db76-3f27-404b-948a-984239b30891/extract/0.log" Jul 01 19:33:06.372254 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:06.372223 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7kqcp_4833a7aa-b8c1-40f2-be86-4489802ccdb4/manager/0.log" Jul 01 19:33:06.484638 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:06.484606 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bjzk5_b50b10ba-8ea0-4b60-9645-369a8b376a03/manager/0.log" Jul 01 19:33:06.714189 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:06.714092 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ctvpv_57e1a0e5-0375-4a4a-81fc-480de4b3d073/registry-server/0.log" Jul 01 19:33:06.840537 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:06.840502 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rc7pv_9b20dfaf-3b95-4379-9b93-edf0d6ff4d35/manager/0.log" Jul 01 19:33:07.568761 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:07.568733 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-f6pc4_e2084be1-ddbf-45dc-a13a-0d18a809ca3f/discovery/0.log" Jul 01 19:33:07.797249 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:07.797220 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7994ff9b78-w6fxs_37ab2364-87b4-4e96-8a98-fb7d22201597/kube-auth-proxy/0.log" Jul 01 19:33:08.030046 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:08.030010 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-l4wnb_d672670b-3397-4a1c-a605-15802c7eb133/payload-pre-processing/0.log" Jul 01 19:33:08.141496 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:08.141454 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-4j5jr_c9b89b23-e50f-4578-8117-9f0aad83bc6a/payload-processing/1.log" Jul 01 19:33:08.378358 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:08.378328 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:33:08.378751 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:08.378737 2551 scope.go:117] "RemoveContainer" containerID="3c2b5d082c40ecdeaa8ff5eb4137ae71965efcfc5034109ea210e52da50d6797" Jul 01 19:33:08.378947 ip-10-0-143-127 kubenswrapper[2551]: E0701 19:33:08.378928 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-4j5jr_openshift-ingress(c9b89b23-e50f-4578-8117-9f0aad83bc6a)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" podUID="c9b89b23-e50f-4578-8117-9f0aad83bc6a" Jul 01 19:33:08.606438 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:08.606407 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-74f954f784-p2mkx_cf287386-db8c-4cda-8710-40a2df78c2d8/main/0.log" Jul 01 19:33:08.946613 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:08.946585 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649fx7cv_bf0ab4af-f515-4225-9c9c-eccc61d19a1f/main/0.log" Jul 01 19:33:13.409544 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:13.409455 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:33:13.471619 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:13.471562 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" limit=1024 Jul 01 19:33:16.366431 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:16.366398 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rcmnr_ee155ec6-3ff7-4afe-a20d-f7ea9289fe00/global-pull-secret-syncer/0.log" Jul 01 19:33:16.464682 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:16.464629 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hc87r_82b42114-21a3-4ff8-87c3-ee5ba49f759f/konnectivity-agent/0.log" Jul 01 19:33:16.603697 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:16.603667 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-127.ec2.internal_2884d80ef841c6fbcfc2434aecfb3b35/haproxy/0.log" Jul 01 19:33:18.300881 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:18.300834 2551 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:33:18.301291 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:18.301275 2551 scope.go:117] "RemoveContainer" containerID="3c2b5d082c40ecdeaa8ff5eb4137ae71965efcfc5034109ea210e52da50d6797" Jul 01 19:33:18.648201 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:18.648160 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" event={"ID":"c9b89b23-e50f-4578-8117-9f0aad83bc6a","Type":"ContainerStarted","Data":"e5306e4a04c345903fb1c494522955b932ef338a910e2b84ca768aa2f3c25ce0"} Jul 01 19:33:18.648393 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:18.648370 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:33:21.260140 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.260108 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg_3d3d05cc-9bed-4c1f-9b71-24069579dd83/extract/0.log" Jul 01 19:33:21.283089 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.283057 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg_3d3d05cc-9bed-4c1f-9b71-24069579dd83/util/0.log" Jul 01 19:33:21.292381 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.292356 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:33:21.292547 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.292427 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggrjp_f988757f-dbbd-417a-9e29-f3d482efb3de/ovn-acl-logging/0.log" Jul 01 19:33:21.309341 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.309313 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dvwvg_3d3d05cc-9bed-4c1f-9b71-24069579dd83/pull/0.log" Jul 01 19:33:21.370796 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.370762 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2_61598140-40e2-49e4-85f5-cb42b5a0d8e2/extract/0.log" Jul 01 19:33:21.394470 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.394440 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2_61598140-40e2-49e4-85f5-cb42b5a0d8e2/util/0.log" Jul 01 19:33:21.428710 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.428662 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rljg2_61598140-40e2-49e4-85f5-cb42b5a0d8e2/pull/0.log" Jul 01 19:33:21.465962 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.465931 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q_9829d4b0-1b67-4c23-9a82-8fcc23159d40/extract/0.log" Jul 01 19:33:21.490647 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.490618 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q_9829d4b0-1b67-4c23-9a82-8fcc23159d40/util/0.log" Jul 01 19:33:21.512321 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.512226 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tjt5q_9829d4b0-1b67-4c23-9a82-8fcc23159d40/pull/0.log" Jul 01 19:33:21.540091 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.540062 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl_9303db76-3f27-404b-948a-984239b30891/extract/0.log" Jul 01 19:33:21.568073 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.568042 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl_9303db76-3f27-404b-948a-984239b30891/util/0.log" Jul 01 19:33:21.605860 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.605818 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6zxl_9303db76-3f27-404b-948a-984239b30891/pull/0.log" Jul 01 19:33:21.673787 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.673757 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7kqcp_4833a7aa-b8c1-40f2-be86-4489802ccdb4/manager/0.log" Jul 01 19:33:21.706550 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.706518 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bjzk5_b50b10ba-8ea0-4b60-9645-369a8b376a03/manager/0.log" Jul 01 19:33:21.768980 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.768897 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ctvpv_57e1a0e5-0375-4a4a-81fc-480de4b3d073/registry-server/0.log" Jul 01 19:33:21.812123 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:21.812088 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rc7pv_9b20dfaf-3b95-4379-9b93-edf0d6ff4d35/manager/0.log" Jul 01 19:33:23.960040 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:23.959988 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f28hn_e254d457-8714-4bd9-b25b-7d39e1d7dbe8/node-exporter/0.log" Jul 01 19:33:23.982081 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:23.982052 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f28hn_e254d457-8714-4bd9-b25b-7d39e1d7dbe8/kube-rbac-proxy/0.log" Jul 01 19:33:24.007880 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:24.007851 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f28hn_e254d457-8714-4bd9-b25b-7d39e1d7dbe8/init-textfile/0.log" Jul 01 19:33:24.260038 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:24.259960 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-sc4pc_36047195-c020-4b44-9e87-1eb8c0ff3f94/kube-rbac-proxy-main/0.log" Jul 01 19:33:24.286013 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:24.285983 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-sc4pc_36047195-c020-4b44-9e87-1eb8c0ff3f94/kube-rbac-proxy-self/0.log" Jul 01 19:33:24.323467 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:24.323428 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-sc4pc_36047195-c020-4b44-9e87-1eb8c0ff3f94/openshift-state-metrics/0.log" Jul 01 19:33:26.467597 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.467566 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc"] Jul 01 19:33:26.471100 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.471084 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.473496 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.473467 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6ssrz\"/\"default-dockercfg-q4zr5\"" Jul 01 19:33:26.474424 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.474399 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ssrz\"/\"openshift-service-ca.crt\"" Jul 01 19:33:26.474545 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.474450 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ssrz\"/\"kube-root-ca.crt\"" Jul 01 19:33:26.479221 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.479193 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc"] Jul 01 19:33:26.479464 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.479439 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-proc\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.479555 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.479495 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcv29\" (UniqueName: \"kubernetes.io/projected/73424ebd-8b30-4261-846e-f985f95b0bbc-kube-api-access-bcv29\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.479555 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.479526 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-podres\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.479664 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.479586 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-sys\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.479738 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.479659 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-lib-modules\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.580543 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.580503 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-lib-modules\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.580787 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.580592 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-proc\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.580787 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.580643 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcv29\" (UniqueName: \"kubernetes.io/projected/73424ebd-8b30-4261-846e-f985f95b0bbc-kube-api-access-bcv29\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.580787 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.580668 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-podres\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.580787 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.580716 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-lib-modules\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.580787 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.580727 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-sys\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.580787 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.580737 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-proc\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.580787 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.580791 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-sys\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.581047 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.580796 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73424ebd-8b30-4261-846e-f985f95b0bbc-podres\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.589283 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.589253 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcv29\" (UniqueName: \"kubernetes.io/projected/73424ebd-8b30-4261-846e-f985f95b0bbc-kube-api-access-bcv29\") pod \"perf-node-gather-daemonset-hmkxc\" (UID: \"73424ebd-8b30-4261-846e-f985f95b0bbc\") " pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.782264 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.782165 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:26.917355 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:26.917330 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc"] Jul 01 19:33:26.918801 ip-10-0-143-127 kubenswrapper[2551]: W0701 19:33:26.918772 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod73424ebd_8b30_4261_846e_f985f95b0bbc.slice/crio-45f497674aa2157402704d9853166763686a81de6dba67764b98a8031d9a4600 WatchSource:0}: Error finding container 45f497674aa2157402704d9853166763686a81de6dba67764b98a8031d9a4600: Status 404 returned error can't find the container with id 45f497674aa2157402704d9853166763686a81de6dba67764b98a8031d9a4600 Jul 01 19:33:27.699033 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:27.698994 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" event={"ID":"73424ebd-8b30-4261-846e-f985f95b0bbc","Type":"ContainerStarted","Data":"43be2888f8e2d90984fb922be90862fb6940dcf86e990f98ccfe7bc181cb1dae"} Jul 01 19:33:27.699436 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:27.699140 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:27.699436 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:27.699184 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" event={"ID":"73424ebd-8b30-4261-846e-f985f95b0bbc","Type":"ContainerStarted","Data":"45f497674aa2157402704d9853166763686a81de6dba67764b98a8031d9a4600"} Jul 01 19:33:27.716370 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:27.716316 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" podStartSLOduration=1.716300747 podStartE2EDuration="1.716300747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:33:27.714049808 +0000 UTC m=+906.894381375" watchObservedRunningTime="2026-07-01 19:33:27.716300747 +0000 UTC m=+906.896632311" Jul 01 19:33:28.972503 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:28.972469 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f9xcw_2b1e0076-dfbc-4a54-9393-3adb2b241e0b/dns/0.log" Jul 01 19:33:28.998452 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:28.998421 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f9xcw_2b1e0076-dfbc-4a54-9393-3adb2b241e0b/kube-rbac-proxy/0.log" Jul 01 19:33:29.188178 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:29.188150 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ntmhl_71cba711-068b-41aa-a58c-69836410353e/dns-node-resolver/0.log" Jul 01 19:33:29.656787 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:29.656755 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-4j5jr" Jul 01 19:33:29.823476 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:29.823434 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s4knf_5bc3f1dd-96e3-42de-bb5d-6bef5d6fa506/node-ca/0.log" Jul 01 19:33:30.907861 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:30.907827 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-f6pc4_e2084be1-ddbf-45dc-a13a-0d18a809ca3f/discovery/0.log" Jul 01 19:33:30.962595 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:30.962561 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7994ff9b78-w6fxs_37ab2364-87b4-4e96-8a98-fb7d22201597/kube-auth-proxy/0.log" Jul 01 19:33:31.031181 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:31.031138 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-l4wnb_d672670b-3397-4a1c-a605-15802c7eb133/payload-pre-processing/0.log" Jul 01 19:33:31.065002 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:31.064972 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-4j5jr_c9b89b23-e50f-4578-8117-9f0aad83bc6a/payload-processing/2.log" Jul 01 19:33:31.066048 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:31.066023 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-4j5jr_c9b89b23-e50f-4578-8117-9f0aad83bc6a/payload-processing/1.log" Jul 01 19:33:31.775973 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:31.775940 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v7p9d_06bda432-14d9-475e-9cbe-775b5a4e8722/serve-healthcheck-canary/0.log" Jul 01 19:33:32.458717 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:32.458673 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ft7dh_aa6ef8b3-cc6e-461d-93b3-fa84d99efaef/kube-rbac-proxy/0.log" Jul 01 19:33:32.479009 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:32.478983 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ft7dh_aa6ef8b3-cc6e-461d-93b3-fa84d99efaef/exporter/0.log" Jul 01 19:33:32.501156 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:32.501131 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ft7dh_aa6ef8b3-cc6e-461d-93b3-fa84d99efaef/extractor/0.log" Jul 01 19:33:33.714538 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:33.714506 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6ssrz/perf-node-gather-daemonset-hmkxc" Jul 01 19:33:34.743841 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:34.743809 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-59994cc79f-f5zsd_3fc460b5-4602-4e81-9e85-d1fecb112d2c/nginx/0.log" Jul 01 19:33:34.829237 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:34.829186 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-b4c85f9dd-fphc8_38247ad3-7c9b-4d74-827b-18b359116d38/maas-api/0.log" Jul 01 19:33:34.849564 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:34.849534 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29715570-nvvc5_c54e5c38-4ba7-4de3-9cb0-e16aec1adf0c/cleanup/0.log" Jul 01 19:33:34.891898 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:34.891865 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c9df66cbd-cx466_ece8464a-a7c9-4670-927f-5a57e3fd9f24/manager/0.log" Jul 01 19:33:35.091146 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:35.091112 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-bdptl_b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea/manager/0.log" Jul 01 19:33:35.109282 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:35.109260 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7744974bcd-bdptl_b2d41c5e-6e73-4a06-9d36-c5e3eeb333ea/copy-manifests/0.log" Jul 01 19:33:35.189748 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:35.189720 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-r65x2_8a1de2b7-6b4e-491c-8834-6b004186c85a/postgres/0.log" Jul 01 19:33:37.246458 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:37.246421 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-f6pc4_e2084be1-ddbf-45dc-a13a-0d18a809ca3f/discovery/0.log" Jul 01 19:33:37.274739 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:37.274705 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7994ff9b78-w6fxs_37ab2364-87b4-4e96-8a98-fb7d22201597/kube-auth-proxy/0.log" Jul 01 19:33:37.308874 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:37.308850 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-l4wnb_d672670b-3397-4a1c-a605-15802c7eb133/payload-pre-processing/0.log" Jul 01 19:33:37.325758 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:37.325731 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-4j5jr_c9b89b23-e50f-4578-8117-9f0aad83bc6a/payload-processing/2.log" Jul 01 19:33:37.326989 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:37.326962 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-4j5jr_c9b89b23-e50f-4578-8117-9f0aad83bc6a/payload-processing/1.log" Jul 01 19:33:38.527533 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:38.527502 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-f6pc4_e2084be1-ddbf-45dc-a13a-0d18a809ca3f/discovery/0.log" Jul 01 19:33:38.564538 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:38.564503 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7994ff9b78-w6fxs_37ab2364-87b4-4e96-8a98-fb7d22201597/kube-auth-proxy/0.log" Jul 01 19:33:38.597040 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:38.597010 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-l4wnb_d672670b-3397-4a1c-a605-15802c7eb133/payload-pre-processing/0.log" Jul 01 19:33:38.613089 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:38.613055 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-4j5jr_c9b89b23-e50f-4578-8117-9f0aad83bc6a/payload-processing/2.log" Jul 01 19:33:38.614232 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:38.614207 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-4j5jr_c9b89b23-e50f-4578-8117-9f0aad83bc6a/payload-processing/1.log" Jul 01 19:33:43.374818 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.374783 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7kckl_8b0c5290-3824-46de-b9b4-2afec243d037/kube-multus/0.log" Jul 01 19:33:43.398090 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.398059 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97zfk_71176e9a-093c-45ea-ac85-dbeb77c94b9f/kube-multus-additional-cni-plugins/0.log" Jul 01 19:33:43.419064 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.419036 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97zfk_71176e9a-093c-45ea-ac85-dbeb77c94b9f/egress-router-binary-copy/0.log" Jul 01 19:33:43.439650 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.439616 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97zfk_71176e9a-093c-45ea-ac85-dbeb77c94b9f/cni-plugins/0.log" Jul 01 19:33:43.461801 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.461774 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97zfk_71176e9a-093c-45ea-ac85-dbeb77c94b9f/bond-cni-plugin/0.log" Jul 01 19:33:43.481661 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.481629 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97zfk_71176e9a-093c-45ea-ac85-dbeb77c94b9f/routeoverride-cni/0.log" Jul 01 19:33:43.500080 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.500050 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97zfk_71176e9a-093c-45ea-ac85-dbeb77c94b9f/whereabouts-cni-bincopy/0.log" Jul 01 19:33:43.521765 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.521736 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97zfk_71176e9a-093c-45ea-ac85-dbeb77c94b9f/whereabouts-cni/0.log" Jul 01 19:33:43.971147 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.971119 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dp5wv_7f2bd16e-ec4a-4b9f-a85e-702aa920d41b/network-metrics-daemon/0.log" Jul 01 19:33:43.993004 ip-10-0-143-127 kubenswrapper[2551]: I0701 19:33:43.992971 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dp5wv_7f2bd16e-ec4a-4b9f-a85e-702aa920d41b/kube-rbac-proxy/0.log"