Jul 01 22:35:44.181364 ip-10-0-128-139 systemd[1]: Starting Kubernetes Kubelet... Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.568948 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572793 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572804 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572808 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572812 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572815 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572818 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572820 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:35:44.642669 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572823 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:35:44.642575 ip-10-0-128-139 systemd[1]: Started Kubernetes Kubelet. Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572825 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572828 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572830 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572833 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572835 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572838 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572841 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572845 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572848 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572851 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572854 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572856 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572861 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572866 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572869 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572872 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572875 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572878 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:35:44.647566 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572881 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572884 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572887 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572890 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572892 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572895 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572899 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572903 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572907 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572909 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572913 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572915 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572918 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572920 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572923 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572925 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572928 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572931 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572933 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:35:44.649633 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572936 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572938 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572941 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572945 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572948 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572951 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572953 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572956 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572959 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572961 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572964 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572967 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572970 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572972 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572975 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572977 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572979 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572982 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572984 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:35:44.656893 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572987 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572991 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572994 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.572997 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573000 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573002 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573005 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573008 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573011 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573013 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573016 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573019 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573021 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573023 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573026 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573029 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573032 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573034 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573037 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573040 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:35:44.660148 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573042 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573044 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573047 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573049 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573053 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573056 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573058 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573061 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573063 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573066 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573069 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573071 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573074 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573076 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573094 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573766 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573773 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573776 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573778 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573781 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:35:44.663845 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573784 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573786 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573789 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573791 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573795 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573797 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573800 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573803 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573806 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573808 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573811 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573814 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573817 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573819 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573822 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573824 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573827 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573830 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573832 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573835 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:35:44.666649 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573838 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573842 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573846 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573848 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573851 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573855 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573858 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573861 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573864 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573867 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573870 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573872 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573877 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573880 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573883 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573886 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573889 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573892 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573895 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:35:44.671560 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573897 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573904 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573907 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573909 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573912 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573915 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573917 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573920 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573922 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573925 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573927 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573932 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573936 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573938 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573941 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573944 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573946 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573949 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573951 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573954 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:35:44.675016 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573957 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573960 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573962 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573965 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573968 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573970 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573973 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573975 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573978 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573980 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573982 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573985 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573987 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573992 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573995 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.573997 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574000 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574002 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574005 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574007 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:35:44.679025 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574010 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574013 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574015 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574018 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574021 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574023 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574026 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574028 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574031 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574033 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574036 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574038 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574040 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574043 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574045 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574411 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574416 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574419 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574422 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:35:44.681790 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574425 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574428 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574431 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574433 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574435 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574438 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574444 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574447 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574449 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574452 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574454 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574458 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574460 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574463 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574466 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574468 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574471 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574474 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574477 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574480 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:35:44.684800 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574482 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574485 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574487 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574490 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574492 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574495 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574497 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574500 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574502 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574505 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574509 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574512 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574515 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574519 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574521 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574524 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574526 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574529 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574534 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:35:44.837601 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574538 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574542 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574544 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574547 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574550 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574553 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574556 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574558 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574561 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574564 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574567 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574569 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574572 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574575 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574577 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574580 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574582 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574585 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574587 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574590 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:35:44.850473 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574593 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574595 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574598 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574600 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574603 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574606 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574608 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574611 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574613 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574616 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574618 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574623 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574626 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574629 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574631 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574634 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574637 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574639 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574642 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574645 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:35:44.851302 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574647 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574649 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574652 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574654 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574657 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574659 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574663 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574665 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574668 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574670 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574673 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574675 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574678 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574680 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574682 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.574685 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574761 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574771 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574780 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574786 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574792 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 22:35:44.852052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574796 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574800 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574807 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574810 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574813 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574817 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574820 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574823 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574826 2561 flags.go:64] FLAG: --cgroup-root="" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574829 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574833 2561 flags.go:64] FLAG: --client-ca-file="" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574836 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574839 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574844 2561 flags.go:64] FLAG: --cluster-domain="" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574846 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574849 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574852 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574855 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574859 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574862 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574865 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574868 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574871 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574874 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 22:35:44.852839 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574877 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574880 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574883 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574887 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574890 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574892 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574895 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574898 2561 flags.go:64] FLAG: --enable-server="true" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574901 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574905 2561 flags.go:64] FLAG: --event-burst="100" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574911 2561 flags.go:64] FLAG: --event-qps="50" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574914 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574917 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574920 2561 flags.go:64] FLAG: --eviction-hard="" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574924 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574926 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574930 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574933 2561 flags.go:64] FLAG: --eviction-soft="" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574936 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574939 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574942 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574945 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574948 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574950 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574953 2561 flags.go:64] FLAG: --feature-gates="" Jul 01 22:35:44.853649 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574957 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574960 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574963 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574966 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574969 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574972 2561 flags.go:64] FLAG: --help="false" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574974 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-128-139.ec2.internal" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574977 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574980 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574983 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574986 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574989 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574992 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574995 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.574998 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575000 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575003 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575009 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575012 2561 flags.go:64] FLAG: --kube-reserved="" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575015 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575018 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575021 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575023 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575026 2561 flags.go:64] FLAG: --lock-file="" Jul 01 22:35:44.854459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575029 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575032 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575035 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575040 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575043 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575046 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575049 2561 flags.go:64] FLAG: --logging-format="text" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575052 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575055 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575057 2561 flags.go:64] FLAG: --manifest-url="" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575060 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575064 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575067 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575071 2561 flags.go:64] FLAG: --max-pods="110" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575074 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575077 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575093 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575096 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575099 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575102 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575105 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575111 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575115 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575117 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 22:35:44.855280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575120 2561 flags.go:64] FLAG: --pod-cidr="" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575130 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575135 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575138 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575141 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575144 2561 flags.go:64] FLAG: --port="10250" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575147 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575150 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03c60454172a3b320" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575153 2561 flags.go:64] FLAG: --qos-reserved="" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575156 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575159 2561 flags.go:64] FLAG: --register-node="true" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575162 2561 flags.go:64] FLAG: --register-with-taints="" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575171 2561 flags.go:64] FLAG: --registry-burst="10" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575174 2561 flags.go:64] FLAG: --registry-qps="5" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575177 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575179 2561 flags.go:64] FLAG: --reserved-memory="" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575183 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575186 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575189 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575192 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575194 2561 flags.go:64] FLAG: --runonce="false" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575197 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575200 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575203 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575206 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 22:35:44.861752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575209 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575211 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575214 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575217 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575220 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575223 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575225 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575228 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575232 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575236 2561 flags.go:64] FLAG: --system-cgroups="" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575239 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575244 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575247 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575250 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575254 2561 flags.go:64] FLAG: --tls-min-version="" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575257 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575260 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575263 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575266 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575269 2561 flags.go:64] FLAG: --v="2" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575273 2561 flags.go:64] FLAG: --version="false" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575277 2561 flags.go:64] FLAG: --vmodule="" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575280 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.575283 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 22:35:44.862588 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575396 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575400 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575404 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575407 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575411 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575414 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575417 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575419 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575422 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575426 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575429 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575432 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575435 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575438 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575441 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575444 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575448 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575452 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575455 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:35:44.873177 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575458 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575460 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575463 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575465 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575468 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575471 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575473 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575476 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575479 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575481 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575484 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575487 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575489 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575492 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575494 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575497 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575499 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575502 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575504 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:35:44.873964 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575507 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575509 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575512 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575514 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575517 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575519 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575521 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575524 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575526 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575529 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575533 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575536 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575539 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575542 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575544 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575547 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575549 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575552 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575554 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575557 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:35:44.984017 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575560 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575562 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575565 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575567 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.575607 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576589 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576599 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576603 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576612 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576618 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576623 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576629 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576633 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576639 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576644 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576649 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576653 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576663 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576667 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:35:44.984804 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576672 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576676 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576680 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576687 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576693 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576697 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576702 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576706 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576710 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576714 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576718 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576727 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576731 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576735 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576740 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576744 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576759 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576763 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576769 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576774 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:35:44.985430 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576779 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.576783 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.577557 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.584055 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.584069 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.584707 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.584715 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584768 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584773 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584776 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584779 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584782 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584785 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584788 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584791 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:35:44.986053 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584794 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584797 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584799 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584803 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584805 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584808 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584811 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584813 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584817 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584821 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584825 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584828 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584830 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584833 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584836 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584839 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584846 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584850 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584853 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:35:44.986675 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584857 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584860 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584863 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584866 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584868 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584871 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584874 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584876 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584879 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584881 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584884 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584887 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584889 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584892 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584894 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584897 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584900 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584902 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584905 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:35:44.987317 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584907 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584910 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584912 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584915 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584918 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584920 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584923 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584926 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584929 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584931 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584935 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584937 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584940 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584943 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584946 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584948 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584951 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584954 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584956 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584959 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:35:44.987957 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584962 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584965 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584967 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584970 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584972 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584975 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584978 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584982 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584986 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584989 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584991 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584994 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584996 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.584999 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585002 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585004 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585007 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585009 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585012 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:35:44.988536 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585015 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585017 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585020 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585024 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585027 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585029 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585032 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585034 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585037 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585039 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585042 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585045 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585047 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585050 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.585055 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:35:44.989045 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585191 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585197 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585200 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585204 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585207 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585210 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585213 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585216 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585219 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585222 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585225 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585227 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585230 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585232 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585235 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585238 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585240 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585243 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585245 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585248 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:35:44.989503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585250 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585255 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585258 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585261 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585263 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585266 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585268 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585271 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585274 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585276 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585279 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585281 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585284 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585287 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585291 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585294 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585298 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585300 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585303 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:35:44.990030 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585306 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585309 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585312 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585314 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585317 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585319 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585322 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585324 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585327 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585330 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585332 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585334 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585337 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585340 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585344 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585346 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585349 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585351 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585354 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585358 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:35:44.990583 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585361 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585364 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585367 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585370 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585372 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585375 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585377 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585380 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585383 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585385 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585388 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585391 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585393 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585397 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585400 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585403 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585405 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585408 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585410 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585413 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:35:44.991124 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585415 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585418 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585421 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585423 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585426 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585428 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585432 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585435 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585437 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585440 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585443 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585447 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585451 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585453 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585456 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585458 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585461 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585463 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585466 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:35:44.991728 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:44.585468 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.585473 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.585593 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.587431 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.588734 2561 server.go:1019] "Starting client certificate rotation" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.588830 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.588863 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.592209 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.596273 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.606143 2561 log.go:25] "Validated CRI v1 runtime API" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.609824 2561 log.go:25] "Validated CRI v1 image API" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.611692 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 22:35:44.992453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.615524 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b0303611-4193-488d-9862-3ce047035511:/dev/nvme0n1p4 e811c9cf-ed79-4b03-aca5-2b722aea581b:/dev/nvme0n1p3] Jul 01 22:35:44.992873 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.615539 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 22:35:44.993098 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.622557 2561 manager.go:216] Machine: {Timestamp:2026-07-01 22:35:44.621408731 +0000 UTC m=+0.317874228 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099895 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25413e349f73a071a183075fcf1646 SystemUUID:ec25413e-349f-73a0-71a1-83075fcf1646 BootID:b6fa4d8d-9a8c-4012-a7e0-801231c3fb2e Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c8:d2:2c:b9:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c8:d2:2c:b9:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:81:97:36:3c:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 22:35:44.993098 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.622649 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 22:35:44.993098 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.622726 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 22:35:44.993098 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.625324 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 22:35:44.993098 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.625343 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 22:35:44.993098 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.626004 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 22:35:44.993098 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.626015 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 22:35:44.993098 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.626022 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.626547 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.627317 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.632688 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.632797 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.633372 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.633383 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.633395 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.633405 2561 kubelet.go:398] "Adding apiserver pod source" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.633413 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.633731 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.633747 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.635749 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.637329 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.637356 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.637853 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.637866 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.637871 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.637877 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.637885 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.637891 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.638006 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.638011 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.638019 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.638027 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.638036 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.638044 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.638675 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.638682 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.640777 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.641891 2561 server.go:1268] "Started kubelet" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.642363 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.642702 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.642790 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.645340 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.645485 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.651005 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.651097 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.651158 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 22:35:44.993517 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.651190 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.653228 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-139.ec2.internal.18be4b583150aaf3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-139.ec2.internal,UID:ip-10-0-128-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-139.ec2.internal,},FirstTimestamp:2026-07-01 22:35:44.641870579 +0000 UTC m=+0.338336076,LastTimestamp:2026-07-01 22:35:44.641870579 +0000 UTC m=+0.338336076,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-139.ec2.internal,}" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.656318 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.656331 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.656424 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657113 2561 factory.go:55] Registering systemd factory Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657128 2561 factory.go:223] Registration of the systemd container factory successfully Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657336 2561 factory.go:153] Registering CRI-O factory Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657371 2561 factory.go:223] Registration of the crio container factory successfully Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657435 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657456 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657444 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657549 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657567 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657610 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657636 2561 factory.go:103] Registering Raw factory Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.657663 2561 manager.go:1196] Started watching for new ooms in manager Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.660069 2561 manager.go:349] Starting recovery of all containers Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.673665 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.673758 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.675575 2561 manager.go:354] Recovery completed Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.680027 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.681932 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.681956 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.681966 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.682474 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.682484 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.682501 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.682511 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.684640 2561 policy_none.go:49] "None policy: Start" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.684661 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.684674 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.685065 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.685134 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:35:44.996837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.685195 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.685949 2561 policy_none.go:47] "Start" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.688305 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jhwdk" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.692685 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-139.ec2.internal.18be4b5833b41fd6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-139.ec2.internal,UID:ip-10-0-128-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-139.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-139.ec2.internal,},FirstTimestamp:2026-07-01 22:35:44.681942998 +0000 UTC m=+0.378408495,LastTimestamp:2026-07-01 22:35:44.681942998 +0000 UTC m=+0.378408495,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-139.ec2.internal,}" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.696058 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jhwdk" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.696994 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-139.ec2.internal.18be4b5833b46451 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-139.ec2.internal,UID:ip-10-0-128-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-139.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-139.ec2.internal,},FirstTimestamp:2026-07-01 22:35:44.681960529 +0000 UTC m=+0.378426025,LastTimestamp:2026-07-01 22:35:44.681960529 +0000 UTC m=+0.378426025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-139.ec2.internal,}" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.709756 2561 manager.go:337] "Starting Device Plugin manager" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.709780 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.709789 2561 server.go:87] "Starting device plugin registration server" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.709975 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.709988 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.710070 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.710158 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.710170 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.710631 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.710680 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.731590 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.732704 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.732750 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.732770 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.732806 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.735154 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.810826 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.811627 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.811652 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.811663 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:35:44.997841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.811684 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.820715 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.820732 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-139.ec2.internal\": node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.833168 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal"] Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.833226 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.834450 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.834476 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.834488 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.835748 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.835874 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.835903 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.836475 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.836491 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.836512 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.836522 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.836498 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.836595 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.837586 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.839232 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.839929 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.839955 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.839965 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.845450 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.942699 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-139.ec2.internal\" not found" node="ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.945626 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:44.947045 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-139.ec2.internal\" not found" node="ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.960828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fc85ddde832fe9e23c9298f18b986ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal\" (UID: \"4fc85ddde832fe9e23c9298f18b986ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.106894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.960848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc85ddde832fe9e23c9298f18b986ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal\" (UID: \"4fc85ddde832fe9e23c9298f18b986ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.107731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:44.960865 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d46c7e440d3290353ae564bd45a93d28-config\") pod \"kube-apiserver-proxy-ip-10-0-128-139.ec2.internal\" (UID: \"d46c7e440d3290353ae564bd45a93d28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.107731 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:45.046654 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:45.107731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:45.060943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc85ddde832fe9e23c9298f18b986ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal\" (UID: \"4fc85ddde832fe9e23c9298f18b986ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.107731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:45.060964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d46c7e440d3290353ae564bd45a93d28-config\") pod \"kube-apiserver-proxy-ip-10-0-128-139.ec2.internal\" (UID: \"d46c7e440d3290353ae564bd45a93d28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.107731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:45.060986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fc85ddde832fe9e23c9298f18b986ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal\" (UID: \"4fc85ddde832fe9e23c9298f18b986ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.107731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:45.061024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fc85ddde832fe9e23c9298f18b986ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal\" (UID: \"4fc85ddde832fe9e23c9298f18b986ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.107731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:45.061045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc85ddde832fe9e23c9298f18b986ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal\" (UID: \"4fc85ddde832fe9e23c9298f18b986ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.107731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:45.061076 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d46c7e440d3290353ae564bd45a93d28-config\") pod \"kube-apiserver-proxy-ip-10-0-128-139.ec2.internal\" (UID: \"d46c7e440d3290353ae564bd45a93d28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.227252 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:45.147355 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:45.337561 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:45.245847 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" Jul 01 22:35:45.337561 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:45.247521 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:45.337561 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:45.249746 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal" Jul 01 22:35:46.481055 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:46.480570 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:46.592430 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:46.581048 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:46.713112 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:46.648047 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:35:46.713112 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:46.682130 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:46.721662 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:46.720543 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 22:35:46.721662 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:46.720671 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 22:35:46.721662 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:46.720693 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 22:35:46.834632 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:46.782970 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:46.834632 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:46.832678 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 22:30:45 +0000 UTC" deadline="2027-12-10 03:12:09.892789166 +0000 UTC" Jul 01 22:35:46.834632 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:46.832703 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12628h36m23.060088989s" Jul 01 22:35:46.962131 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:46.883434 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:35:46.962131 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:46.883443 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:46.984251 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:46.983697 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:47.097894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:46.999237 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:35:47.097894 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.084448 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:47.215606 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.184882 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-139.ec2.internal\" not found" Jul 01 22:35:47.215606 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.188301 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:35:47.215606 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.189231 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal" Jul 01 22:35:47.215606 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.204169 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 22:35:47.215606 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.206085 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" Jul 01 22:35:47.338086 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.248816 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 22:35:47.618958 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.618895 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:35:47.618958 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.618939 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:35:47.618958 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.618954 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:35:47.715871 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.715843 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:35:47.767365 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.767343 2561 apiserver.go:52] "Watching apiserver" Jul 01 22:35:47.776567 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.776544 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 22:35:47.776941 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.776920 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal","openshift-multus/multus-pkjrx","openshift-multus/network-metrics-daemon-r8wqz","openshift-network-operator/iptables-alerter-8mfnl","openshift-ovn-kubernetes/ovnkube-node-pgww5","kube-system/global-pull-secret-syncer-k9f7s","kube-system/konnectivity-agent-hhcls","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv","openshift-dns/node-resolver-xg8h2","openshift-image-registry/node-ca-6fphh","openshift-multus/multus-additional-cni-plugins-m6hdw","openshift-network-diagnostics/network-check-target-8hbnk","kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8bcsb"] Jul 01 22:35:47.778343 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.778321 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.779275 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.779253 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.780291 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.780273 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:47.780366 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.780344 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:35:47.781191 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.781170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:35:47.782244 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.782227 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.782341 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.782319 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zbl5f\"" Jul 01 22:35:47.782436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.782230 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 22:35:47.782706 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.782692 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:35:47.782945 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.782928 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 22:35:47.783000 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.782935 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 22:35:47.783196 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.783181 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cfpmb\"" Jul 01 22:35:47.783308 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.783295 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:47.783376 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.783352 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:35:47.783490 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.783477 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 22:35:47.783558 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.783536 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 22:35:47.783615 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.783589 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 22:35:47.783615 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.783535 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mlk8n\"" Jul 01 22:35:47.783889 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.783877 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 22:35:47.784486 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.784473 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.785339 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.785322 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 22:35:47.785483 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.785362 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 22:35:47.785483 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.785400 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 22:35:47.785483 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.785410 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z9652\"" Jul 01 22:35:47.785483 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.785457 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 22:35:47.785987 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.785968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.786103 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.786069 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 22:35:47.786187 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.786174 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 22:35:47.787048 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.787030 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.787225 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.787194 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 22:35:47.787303 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.787235 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 22:35:47.787835 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.787816 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n9kk7\"" Jul 01 22:35:47.787930 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.787818 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 22:35:47.788201 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.788185 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.788201 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.788196 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 22:35:47.788335 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.788297 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v5pmk\"" Jul 01 22:35:47.788699 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.788685 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 22:35:47.789014 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.788989 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 22:35:47.789240 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.789228 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 22:35:47.789485 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.789467 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:47.789606 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.789580 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:35:47.789763 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.789750 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dsnmh\"" Jul 01 22:35:47.789848 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.789835 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 22:35:47.790598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.790580 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 22:35:47.790598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.790592 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 22:35:47.790702 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.790597 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-27vsc\"" Jul 01 22:35:47.791044 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.791022 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 22:35:47.791199 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.791170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.796504 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.796487 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 22:35:47.796605 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.796585 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 22:35:47.796698 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.796588 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:35:47.797503 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.797483 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8jbl5\"" Jul 01 22:35:47.802540 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/336fb92b-16f8-45d9-94c8-56f4589349e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.802622 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ee68d82-2064-4955-b877-5a45fdec1443-iptables-alerter-script\") pod \"iptables-alerter-8mfnl\" (UID: \"0ee68d82-2064-4955-b877-5a45fdec1443\") " pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.802622 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-run-multus-certs\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.802692 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-slash\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.802692 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-socket-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.802692 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwn59\" (UniqueName: \"kubernetes.io/projected/88133730-336e-4b16-b84e-d0ec10ab6e57-kube-api-access-mwn59\") pod \"node-resolver-xg8h2\" (UID: \"88133730-336e-4b16-b84e-d0ec10ab6e57\") " pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.802783 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpqfq\" (UniqueName: \"kubernetes.io/projected/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-kube-api-access-rpqfq\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.802783 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8be253c7-946e-4e03-a6a9-b93dbb386cdd-konnectivity-ca\") pod \"konnectivity-agent-hhcls\" (UID: \"8be253c7-946e-4e03-a6a9-b93dbb386cdd\") " pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:35:47.802783 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-system-cni-dir\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.802783 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-etc-kubernetes\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.802925 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-run-netns\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.802925 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802820 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-log-socket\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.802925 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802840 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-modprobe-d\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.802925 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vptvr\" (UniqueName: \"kubernetes.io/projected/0ee68d82-2064-4955-b877-5a45fdec1443-kube-api-access-vptvr\") pod \"iptables-alerter-8mfnl\" (UID: \"0ee68d82-2064-4955-b877-5a45fdec1443\") " pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.802925 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-socket-dir-parent\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.802925 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-var-lib-cni-bin\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.803105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-systemd-units\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.803105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-run-systemd\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.803105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.802969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/903919bd-c073-460c-b4d3-b0159dfc8e6e-ovn-node-metrics-cert\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.803105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803000 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-lib-modules\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.803105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803023 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-sysctl-d\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.803105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803067 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-run\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.803105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-cnibin\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-run-ovn\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-system-cni-dir\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmh6n\" (UniqueName: \"kubernetes.io/projected/336fb92b-16f8-45d9-94c8-56f4589349e9-kube-api-access-cmh6n\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-hostroot\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-device-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-host\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-conf-dir\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-etc-selinux\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9050c27a-17ba-471f-a3e8-ce4a6886ce5a-serviceca\") pod \"node-ca-6fphh\" (UID: \"9050c27a-17ba-471f-a3e8-ce4a6886ce5a\") " pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88133730-336e-4b16-b84e-d0ec10ab6e57-tmp-dir\") pod \"node-resolver-xg8h2\" (UID: \"88133730-336e-4b16-b84e-d0ec10ab6e57\") " pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/336fb92b-16f8-45d9-94c8-56f4589349e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.803413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-node-log\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-sysctl-conf\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-var-lib-kubelet\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803499 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-os-release\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-cni-dir\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803550 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60e99142-dfa9-4b5d-a05d-9de40d049de7-cni-binary-copy\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-var-lib-openvswitch\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-etc-openvswitch\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-sysconfig\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803676 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8be253c7-946e-4e03-a6a9-b93dbb386cdd-agent-certs\") pod \"konnectivity-agent-hhcls\" (UID: \"8be253c7-946e-4e03-a6a9-b93dbb386cdd\") " pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803714 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-run-k8s-cni-cncf-io\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-cni-netd\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.803854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmm2c\" (UniqueName: \"kubernetes.io/projected/903919bd-c073-460c-b4d3-b0159dfc8e6e-kube-api-access-qmm2c\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88133730-336e-4b16-b84e-d0ec10ab6e57-hosts-file\") pod \"node-resolver-xg8h2\" (UID: \"88133730-336e-4b16-b84e-d0ec10ab6e57\") " pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-os-release\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/903919bd-c073-460c-b4d3-b0159dfc8e6e-ovnkube-config\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9050c27a-17ba-471f-a3e8-ce4a6886ce5a-host\") pod \"node-ca-6fphh\" (UID: \"9050c27a-17ba-471f-a3e8-ce4a6886ce5a\") " pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee68d82-2064-4955-b877-5a45fdec1443-host-slash\") pod \"iptables-alerter-8mfnl\" (UID: \"0ee68d82-2064-4955-b877-5a45fdec1443\") " pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rqdt\" (UniqueName: \"kubernetes.io/projected/60e99142-dfa9-4b5d-a05d-9de40d049de7-kube-api-access-4rqdt\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-run-openvswitch\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-cni-bin\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-registration-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-sys-fs\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp56z\" (UniqueName: \"kubernetes.io/projected/693a709d-addb-4717-a3e9-451476c44335-kube-api-access-pp56z\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.803997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-kubernetes\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804014 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-tuned\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.804249 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-tmp\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-run-netns\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/229c282a-5503-4f16-9dd1-48eff34a1972-kubelet-config\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/229c282a-5503-4f16-9dd1-48eff34a1972-dbus\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-sys\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-systemd\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804120 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/336fb92b-16f8-45d9-94c8-56f4589349e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-cnibin\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-var-lib-cni-multus\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-daemon-config\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-kubelet\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804261 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-277ms\" (UniqueName: \"kubernetes.io/projected/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-kube-api-access-277ms\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:47.804639 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-var-lib-kubelet\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.805013 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.805013 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/903919bd-c073-460c-b4d3-b0159dfc8e6e-env-overrides\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.805013 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/903919bd-c073-460c-b4d3-b0159dfc8e6e-ovnkube-script-lib\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.805013 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804357 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:47.805013 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.804371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7lwf\" (UniqueName: \"kubernetes.io/projected/9050c27a-17ba-471f-a3e8-ce4a6886ce5a-kube-api-access-k7lwf\") pod \"node-ca-6fphh\" (UID: \"9050c27a-17ba-471f-a3e8-ce4a6886ce5a\") " pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.809462 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.809446 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 22:35:47.842285 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.842198 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gkdgm" Jul 01 22:35:47.853234 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.853216 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gkdgm" Jul 01 22:35:47.891056 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.891039 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 22:35:47.904514 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-os-release\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.904581 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-cni-dir\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.904581 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60e99142-dfa9-4b5d-a05d-9de40d049de7-cni-binary-copy\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.904581 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-var-lib-openvswitch\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.904581 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904564 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-etc-openvswitch\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.904581 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-sysconfig\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8be253c7-946e-4e03-a6a9-b93dbb386cdd-agent-certs\") pod \"konnectivity-agent-hhcls\" (UID: \"8be253c7-946e-4e03-a6a9-b93dbb386cdd\") " pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-run-k8s-cni-cncf-io\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-os-release\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-cni-netd\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904647 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-var-lib-openvswitch\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmm2c\" (UniqueName: \"kubernetes.io/projected/903919bd-c073-460c-b4d3-b0159dfc8e6e-kube-api-access-qmm2c\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88133730-336e-4b16-b84e-d0ec10ab6e57-hosts-file\") pod \"node-resolver-xg8h2\" (UID: \"88133730-336e-4b16-b84e-d0ec10ab6e57\") " pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904718 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-run-k8s-cni-cncf-io\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-cni-netd\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-os-release\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-sysconfig\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904767 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-cni-dir\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.904819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/903919bd-c073-460c-b4d3-b0159dfc8e6e-ovnkube-config\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-os-release\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88133730-336e-4b16-b84e-d0ec10ab6e57-hosts-file\") pod \"node-resolver-xg8h2\" (UID: \"88133730-336e-4b16-b84e-d0ec10ab6e57\") " pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9050c27a-17ba-471f-a3e8-ce4a6886ce5a-host\") pod \"node-ca-6fphh\" (UID: \"9050c27a-17ba-471f-a3e8-ce4a6886ce5a\") " pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904930 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee68d82-2064-4955-b877-5a45fdec1443-host-slash\") pod \"iptables-alerter-8mfnl\" (UID: \"0ee68d82-2064-4955-b877-5a45fdec1443\") " pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9050c27a-17ba-471f-a3e8-ce4a6886ce5a-host\") pod \"node-ca-6fphh\" (UID: \"9050c27a-17ba-471f-a3e8-ce4a6886ce5a\") " pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rqdt\" (UniqueName: \"kubernetes.io/projected/60e99142-dfa9-4b5d-a05d-9de40d049de7-kube-api-access-4rqdt\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905005 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-run-openvswitch\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-cni-bin\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.904986 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee68d82-2064-4955-b877-5a45fdec1443-host-slash\") pod \"iptables-alerter-8mfnl\" (UID: \"0ee68d82-2064-4955-b877-5a45fdec1443\") " pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-registration-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905032 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-sys-fs\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905093 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-cni-bin\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.905436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp56z\" (UniqueName: \"kubernetes.io/projected/693a709d-addb-4717-a3e9-451476c44335-kube-api-access-pp56z\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905117 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-run-openvswitch\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905129 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-kubernetes\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-tuned\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-registration-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-sys-fs\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905185 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-tmp\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-run-netns\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/229c282a-5503-4f16-9dd1-48eff34a1972-kubelet-config\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905309 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-etc-openvswitch\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905313 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/229c282a-5503-4f16-9dd1-48eff34a1972-dbus\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-sys\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905283 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-run-netns\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-systemd\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/336fb92b-16f8-45d9-94c8-56f4589349e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.906082 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/229c282a-5503-4f16-9dd1-48eff34a1972-kubelet-config\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-cnibin\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-var-lib-cni-multus\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905460 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-sys\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-daemon-config\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-kubelet\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905514 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60e99142-dfa9-4b5d-a05d-9de40d049de7-cni-binary-copy\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905522 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-cnibin\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905314 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-kubernetes\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-systemd\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905525 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/903919bd-c073-460c-b4d3-b0159dfc8e6e-ovnkube-config\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905517 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905592 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-var-lib-cni-multus\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.906660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905657 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/229c282a-5503-4f16-9dd1-48eff34a1972-dbus\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-277ms\" (UniqueName: \"kubernetes.io/projected/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-kube-api-access-277ms\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905693 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-var-lib-kubelet\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.905730 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/903919bd-c073-460c-b4d3-b0159dfc8e6e-env-overrides\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905761 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-kubelet\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905770 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/903919bd-c073-460c-b4d3-b0159dfc8e6e-ovnkube-script-lib\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905831 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-var-lib-kubelet\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.905846 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs podName:9e6b90a5-73e8-4552-b7a3-d2e2b56674f4 nodeName:}" failed. No retries permitted until 2026-07-01 22:35:48.405813767 +0000 UTC m=+2.969569045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs") pod "network-metrics-daemon-r8wqz" (UID: "9e6b90a5-73e8-4552-b7a3-d2e2b56674f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7lwf\" (UniqueName: \"kubernetes.io/projected/9050c27a-17ba-471f-a3e8-ce4a6886ce5a-kube-api-access-k7lwf\") pod \"node-ca-6fphh\" (UID: \"9050c27a-17ba-471f-a3e8-ce4a6886ce5a\") " pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.905907 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/336fb92b-16f8-45d9-94c8-56f4589349e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.907323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905940 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ee68d82-2064-4955-b877-5a45fdec1443-iptables-alerter-script\") pod \"iptables-alerter-8mfnl\" (UID: \"0ee68d82-2064-4955-b877-5a45fdec1443\") " pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.905966 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret podName:229c282a-5503-4f16-9dd1-48eff34a1972 nodeName:}" failed. No retries permitted until 2026-07-01 22:35:48.405949096 +0000 UTC m=+2.969704375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret") pod "global-pull-secret-syncer-k9f7s" (UID: "229c282a-5503-4f16-9dd1-48eff34a1972") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.905996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-run-multus-certs\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906020 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-daemon-config\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-slash\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-socket-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwn59\" (UniqueName: \"kubernetes.io/projected/88133730-336e-4b16-b84e-d0ec10ab6e57-kube-api-access-mwn59\") pod \"node-resolver-xg8h2\" (UID: \"88133730-336e-4b16-b84e-d0ec10ab6e57\") " pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpqfq\" (UniqueName: \"kubernetes.io/projected/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-kube-api-access-rpqfq\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8be253c7-946e-4e03-a6a9-b93dbb386cdd-konnectivity-ca\") pod \"konnectivity-agent-hhcls\" (UID: \"8be253c7-946e-4e03-a6a9-b93dbb386cdd\") " pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-system-cni-dir\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-etc-kubernetes\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-run-netns\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906213 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/336fb92b-16f8-45d9-94c8-56f4589349e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906245 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-log-socket\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.907928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-modprobe-d\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vptvr\" (UniqueName: \"kubernetes.io/projected/0ee68d82-2064-4955-b877-5a45fdec1443-kube-api-access-vptvr\") pod \"iptables-alerter-8mfnl\" (UID: \"0ee68d82-2064-4955-b877-5a45fdec1443\") " pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906318 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-socket-dir-parent\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906339 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-socket-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-var-lib-cni-bin\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906368 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-socket-dir-parent\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-systemd-units\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-run-multus-certs\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-run-systemd\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/903919bd-c073-460c-b4d3-b0159dfc8e6e-ovn-node-metrics-cert\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906447 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-run-systemd\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906476 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-lib-modules\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/336fb92b-16f8-45d9-94c8-56f4589349e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.908552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ee68d82-2064-4955-b877-5a45fdec1443-iptables-alerter-script\") pod \"iptables-alerter-8mfnl\" (UID: \"0ee68d82-2064-4955-b877-5a45fdec1443\") " pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-sysctl-d\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906544 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-host-var-lib-cni-bin\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906574 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-run-netns\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906645 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-sysctl-d\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-host-slash\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906757 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-lib-modules\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-etc-kubernetes\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-run\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906848 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/903919bd-c073-460c-b4d3-b0159dfc8e6e-env-overrides\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906865 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-system-cni-dir\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906866 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-run\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-cnibin\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-run-ovn\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-modprobe-d\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-system-cni-dir\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.906995 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmh6n\" (UniqueName: \"kubernetes.io/projected/336fb92b-16f8-45d9-94c8-56f4589349e9-kube-api-access-cmh6n\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907039 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-systemd-units\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-hostroot\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-device-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-host\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907141 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8be253c7-946e-4e03-a6a9-b93dbb386cdd-konnectivity-ca\") pod \"konnectivity-agent-hhcls\" (UID: \"8be253c7-946e-4e03-a6a9-b93dbb386cdd\") " pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-conf-dir\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-etc-selinux\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9050c27a-17ba-471f-a3e8-ce4a6886ce5a-serviceca\") pod \"node-ca-6fphh\" (UID: \"9050c27a-17ba-471f-a3e8-ce4a6886ce5a\") " pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907286 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-system-cni-dir\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88133730-336e-4b16-b84e-d0ec10ab6e57-tmp-dir\") pod \"node-resolver-xg8h2\" (UID: \"88133730-336e-4b16-b84e-d0ec10ab6e57\") " pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907340 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/336fb92b-16f8-45d9-94c8-56f4589349e9-cnibin\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.909449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907388 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-hostroot\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907653 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/903919bd-c073-460c-b4d3-b0159dfc8e6e-ovnkube-script-lib\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907681 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60e99142-dfa9-4b5d-a05d-9de40d049de7-multus-conf-dir\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/336fb92b-16f8-45d9-94c8-56f4589349e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-node-log\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907739 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-etc-selinux\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907767 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-host\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-sysctl-conf\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907819 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-var-lib-kubelet\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/693a709d-addb-4717-a3e9-451476c44335-device-dir\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-node-log\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.907715 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-run-ovn\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.908138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88133730-336e-4b16-b84e-d0ec10ab6e57-tmp-dir\") pod \"node-resolver-xg8h2\" (UID: \"88133730-336e-4b16-b84e-d0ec10ab6e57\") " pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.908190 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9050c27a-17ba-471f-a3e8-ce4a6886ce5a-serviceca\") pod \"node-ca-6fphh\" (UID: \"9050c27a-17ba-471f-a3e8-ce4a6886ce5a\") " pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.909852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.908212 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-var-lib-kubelet\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.910230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.908204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-sysctl-conf\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.910230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.908292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/903919bd-c073-460c-b4d3-b0159dfc8e6e-log-socket\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.910230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.908648 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/336fb92b-16f8-45d9-94c8-56f4589349e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.910230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.908994 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-etc-tuned\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.910230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.909030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-tmp\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.910230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.909084 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/903919bd-c073-460c-b4d3-b0159dfc8e6e-ovn-node-metrics-cert\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.910230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.909416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8be253c7-946e-4e03-a6a9-b93dbb386cdd-agent-certs\") pod \"konnectivity-agent-hhcls\" (UID: \"8be253c7-946e-4e03-a6a9-b93dbb386cdd\") " pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:35:47.921633 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.921612 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmm2c\" (UniqueName: \"kubernetes.io/projected/903919bd-c073-460c-b4d3-b0159dfc8e6e-kube-api-access-qmm2c\") pod \"ovnkube-node-pgww5\" (UID: \"903919bd-c073-460c-b4d3-b0159dfc8e6e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:47.922846 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.922825 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp56z\" (UniqueName: \"kubernetes.io/projected/693a709d-addb-4717-a3e9-451476c44335-kube-api-access-pp56z\") pod \"aws-ebs-csi-driver-node-c6srv\" (UID: \"693a709d-addb-4717-a3e9-451476c44335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:47.931702 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.931685 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7lwf\" (UniqueName: \"kubernetes.io/projected/9050c27a-17ba-471f-a3e8-ce4a6886ce5a-kube-api-access-k7lwf\") pod \"node-ca-6fphh\" (UID: \"9050c27a-17ba-471f-a3e8-ce4a6886ce5a\") " pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:47.936971 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.936947 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vptvr\" (UniqueName: \"kubernetes.io/projected/0ee68d82-2064-4955-b877-5a45fdec1443-kube-api-access-vptvr\") pod \"iptables-alerter-8mfnl\" (UID: \"0ee68d82-2064-4955-b877-5a45fdec1443\") " pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:47.937114 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.937099 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwn59\" (UniqueName: \"kubernetes.io/projected/88133730-336e-4b16-b84e-d0ec10ab6e57-kube-api-access-mwn59\") pod \"node-resolver-xg8h2\" (UID: \"88133730-336e-4b16-b84e-d0ec10ab6e57\") " pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:47.939626 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.939587 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:35:47.939626 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.939614 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:35:47.939626 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.939627 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qbqhw for pod openshift-network-diagnostics/network-check-target-8hbnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:47.939836 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.939641 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpqfq\" (UniqueName: \"kubernetes.io/projected/aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09-kube-api-access-rpqfq\") pod \"tuned-8bcsb\" (UID: \"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09\") " pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:47.939836 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:47.939748 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw podName:fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf nodeName:}" failed. No retries permitted until 2026-07-01 22:35:48.439721593 +0000 UTC m=+3.003476885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qbqhw" (UniqueName: "kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw") pod "network-check-target-8hbnk" (UID: "fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:47.940498 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.940479 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmh6n\" (UniqueName: \"kubernetes.io/projected/336fb92b-16f8-45d9-94c8-56f4589349e9-kube-api-access-cmh6n\") pod \"multus-additional-cni-plugins-m6hdw\" (UID: \"336fb92b-16f8-45d9-94c8-56f4589349e9\") " pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:47.940620 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.940598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-277ms\" (UniqueName: \"kubernetes.io/projected/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-kube-api-access-277ms\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:47.941060 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:47.941045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rqdt\" (UniqueName: \"kubernetes.io/projected/60e99142-dfa9-4b5d-a05d-9de40d049de7-kube-api-access-4rqdt\") pod \"multus-pkjrx\" (UID: \"60e99142-dfa9-4b5d-a05d-9de40d049de7\") " pod="openshift-multus/multus-pkjrx" Jul 01 22:35:48.103118 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.103078 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46c7e440d3290353ae564bd45a93d28.slice/crio-44f6e252deaaf0895a0aea21e75e834beb70526145aa31b6c873a7f9dcda9e9f WatchSource:0}: Error finding container 44f6e252deaaf0895a0aea21e75e834beb70526145aa31b6c873a7f9dcda9e9f: Status 404 returned error can't find the container with id 44f6e252deaaf0895a0aea21e75e834beb70526145aa31b6c873a7f9dcda9e9f Jul 01 22:35:48.103287 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.103260 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc85ddde832fe9e23c9298f18b986ba.slice/crio-c4fd71ea5ab98be5801502c8cfc0834488def0c1bdb89cd54cd41ebec4547080 WatchSource:0}: Error finding container c4fd71ea5ab98be5801502c8cfc0834488def0c1bdb89cd54cd41ebec4547080: Status 404 returned error can't find the container with id c4fd71ea5ab98be5801502c8cfc0834488def0c1bdb89cd54cd41ebec4547080 Jul 01 22:35:48.111362 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.111345 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:35:48.115122 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.115100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" Jul 01 22:35:48.122820 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.122788 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa14ad09_01a1_4d37_9d6d_f3c8ddcaed09.slice/crio-10f0d0516615a33434644a6ef575c5453a7ff6bbc14941b9d3e5f3bf9bee6e79 WatchSource:0}: Error finding container 10f0d0516615a33434644a6ef575c5453a7ff6bbc14941b9d3e5f3bf9bee6e79: Status 404 returned error can't find the container with id 10f0d0516615a33434644a6ef575c5453a7ff6bbc14941b9d3e5f3bf9bee6e79 Jul 01 22:35:48.130889 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.130843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pkjrx" Jul 01 22:35:48.136993 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.136974 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e99142_dfa9_4b5d_a05d_9de40d049de7.slice/crio-b34ab66544d8a01b2c97d4fb7819dbf861b9f1eb35789a47b5b86538eca88026 WatchSource:0}: Error finding container b34ab66544d8a01b2c97d4fb7819dbf861b9f1eb35789a47b5b86538eca88026: Status 404 returned error can't find the container with id b34ab66544d8a01b2c97d4fb7819dbf861b9f1eb35789a47b5b86538eca88026 Jul 01 22:35:48.142930 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.142909 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:35:48.151951 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.151930 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be253c7_946e_4e03_a6a9_b93dbb386cdd.slice/crio-089dba8dcfc85c707b999f63460e632ac2ba470735e53ed8192d998d51569da2 WatchSource:0}: Error finding container 089dba8dcfc85c707b999f63460e632ac2ba470735e53ed8192d998d51569da2: Status 404 returned error can't find the container with id 089dba8dcfc85c707b999f63460e632ac2ba470735e53ed8192d998d51569da2 Jul 01 22:35:48.158075 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.158058 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:35:48.162027 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.162009 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" Jul 01 22:35:48.164450 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.164430 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903919bd_c073_460c_b4d3_b0159dfc8e6e.slice/crio-6d4136a6518bcd9d1d3b0f8dc0a46ef03b14adfe01f7b828ff05ee35c445fd7f WatchSource:0}: Error finding container 6d4136a6518bcd9d1d3b0f8dc0a46ef03b14adfe01f7b828ff05ee35c445fd7f: Status 404 returned error can't find the container with id 6d4136a6518bcd9d1d3b0f8dc0a46ef03b14adfe01f7b828ff05ee35c445fd7f Jul 01 22:35:48.168486 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.168460 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693a709d_addb_4717_a3e9_451476c44335.slice/crio-f0d881c3c907f14852a41cff941a91d6c13207b8b3c29046e0a88d34915be20d WatchSource:0}: Error finding container f0d881c3c907f14852a41cff941a91d6c13207b8b3c29046e0a88d34915be20d: Status 404 returned error can't find the container with id f0d881c3c907f14852a41cff941a91d6c13207b8b3c29046e0a88d34915be20d Jul 01 22:35:48.178310 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.178294 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xg8h2" Jul 01 22:35:48.185100 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.185081 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88133730_336e_4b16_b84e_d0ec10ab6e57.slice/crio-1963f02c0d2e52634fe5957cf50c5559caf7df56b983458720e1d679e8a79325 WatchSource:0}: Error finding container 1963f02c0d2e52634fe5957cf50c5559caf7df56b983458720e1d679e8a79325: Status 404 returned error can't find the container with id 1963f02c0d2e52634fe5957cf50c5559caf7df56b983458720e1d679e8a79325 Jul 01 22:35:48.201491 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.201468 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fphh" Jul 01 22:35:48.207939 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.207915 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9050c27a_17ba_471f_a3e8_ce4a6886ce5a.slice/crio-bbbb85a4113f6850ad14301df59a9529cd57f28a8f2b0a06912d2c56d0340e6d WatchSource:0}: Error finding container bbbb85a4113f6850ad14301df59a9529cd57f28a8f2b0a06912d2c56d0340e6d: Status 404 returned error can't find the container with id bbbb85a4113f6850ad14301df59a9529cd57f28a8f2b0a06912d2c56d0340e6d Jul 01 22:35:48.220663 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.220649 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" Jul 01 22:35:48.227063 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.227047 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336fb92b_16f8_45d9_94c8_56f4589349e9.slice/crio-efbcde324579771bbf6e22a3eb3ea03b37b67cb3c425c9e0d7a280a824e4948d WatchSource:0}: Error finding container efbcde324579771bbf6e22a3eb3ea03b37b67cb3c425c9e0d7a280a824e4948d: Status 404 returned error can't find the container with id efbcde324579771bbf6e22a3eb3ea03b37b67cb3c425c9e0d7a280a824e4948d Jul 01 22:35:48.230441 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.230423 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8mfnl" Jul 01 22:35:48.237719 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:35:48.237704 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee68d82_2064_4955_b877_5a45fdec1443.slice/crio-900282bfda86c0d643e4e1b7d2c300b5fbb832a79fdc6c681562569087c0afb8 WatchSource:0}: Error finding container 900282bfda86c0d643e4e1b7d2c300b5fbb832a79fdc6c681562569087c0afb8: Status 404 returned error can't find the container with id 900282bfda86c0d643e4e1b7d2c300b5fbb832a79fdc6c681562569087c0afb8 Jul 01 22:35:48.239119 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.239101 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-8mfnl_openshift-network-operator(0ee68d82-2064-4955-b877-5a45fdec1443): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 01 22:35:48.239181 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.239146 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-8mfnl" podUID="0ee68d82-2064-4955-b877-5a45fdec1443" Jul 01 22:35:48.411437 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.411372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:48.411437 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.411405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:48.411620 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.411507 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:48.411620 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.411524 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:48.411620 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.411549 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret podName:229c282a-5503-4f16-9dd1-48eff34a1972 nodeName:}" failed. No retries permitted until 2026-07-01 22:35:49.411537398 +0000 UTC m=+3.975292681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret") pod "global-pull-secret-syncer-k9f7s" (UID: "229c282a-5503-4f16-9dd1-48eff34a1972") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:48.411620 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.411575 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs podName:9e6b90a5-73e8-4552-b7a3-d2e2b56674f4 nodeName:}" failed. No retries permitted until 2026-07-01 22:35:49.411559752 +0000 UTC m=+3.975315046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs") pod "network-metrics-daemon-r8wqz" (UID: "9e6b90a5-73e8-4552-b7a3-d2e2b56674f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:48.512642 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.512610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:48.512851 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.512832 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:35:48.512927 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.512858 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:35:48.512927 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.512871 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qbqhw for pod openshift-network-diagnostics/network-check-target-8hbnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:48.513012 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.512933 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw podName:fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf nodeName:}" failed. No retries permitted until 2026-07-01 22:35:49.512913047 +0000 UTC m=+4.076668341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbqhw" (UniqueName: "kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw") pod "network-check-target-8hbnk" (UID: "fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:48.624007 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.623879 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" event={"ID":"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09","Type":"ContainerStarted","Data":"10f0d0516615a33434644a6ef575c5453a7ff6bbc14941b9d3e5f3bf9bee6e79"} Jul 01 22:35:48.625215 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.625150 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" event={"ID":"4fc85ddde832fe9e23c9298f18b986ba","Type":"ContainerStarted","Data":"c4fd71ea5ab98be5801502c8cfc0834488def0c1bdb89cd54cd41ebec4547080"} Jul 01 22:35:48.626616 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.626592 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xg8h2" event={"ID":"88133730-336e-4b16-b84e-d0ec10ab6e57","Type":"ContainerStarted","Data":"1963f02c0d2e52634fe5957cf50c5559caf7df56b983458720e1d679e8a79325"} Jul 01 22:35:48.627877 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.627856 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" event={"ID":"693a709d-addb-4717-a3e9-451476c44335","Type":"ContainerStarted","Data":"f0d881c3c907f14852a41cff941a91d6c13207b8b3c29046e0a88d34915be20d"} Jul 01 22:35:48.629479 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.629438 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerStarted","Data":"6d4136a6518bcd9d1d3b0f8dc0a46ef03b14adfe01f7b828ff05ee35c445fd7f"} Jul 01 22:35:48.638335 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.638309 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal" event={"ID":"d46c7e440d3290353ae564bd45a93d28","Type":"ContainerStarted","Data":"44f6e252deaaf0895a0aea21e75e834beb70526145aa31b6c873a7f9dcda9e9f"} Jul 01 22:35:48.640656 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.640044 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8mfnl" event={"ID":"0ee68d82-2064-4955-b877-5a45fdec1443","Type":"ContainerStarted","Data":"900282bfda86c0d643e4e1b7d2c300b5fbb832a79fdc6c681562569087c0afb8"} Jul 01 22:35:48.641701 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.641599 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f43eaf0e21117a4bf758b96c52eef182d0992f563fbd42f506512451f84022db\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-8mfnl" podUID="0ee68d82-2064-4955-b877-5a45fdec1443" Jul 01 22:35:48.642271 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.642228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" event={"ID":"336fb92b-16f8-45d9-94c8-56f4589349e9","Type":"ContainerStarted","Data":"efbcde324579771bbf6e22a3eb3ea03b37b67cb3c425c9e0d7a280a824e4948d"} Jul 01 22:35:48.643739 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.643714 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fphh" event={"ID":"9050c27a-17ba-471f-a3e8-ce4a6886ce5a","Type":"ContainerStarted","Data":"bbbb85a4113f6850ad14301df59a9529cd57f28a8f2b0a06912d2c56d0340e6d"} Jul 01 22:35:48.645375 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.645353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hhcls" event={"ID":"8be253c7-946e-4e03-a6a9-b93dbb386cdd","Type":"ContainerStarted","Data":"089dba8dcfc85c707b999f63460e632ac2ba470735e53ed8192d998d51569da2"} Jul 01 22:35:48.648406 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.648385 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pkjrx" event={"ID":"60e99142-dfa9-4b5d-a05d-9de40d049de7","Type":"ContainerStarted","Data":"b34ab66544d8a01b2c97d4fb7819dbf861b9f1eb35789a47b5b86538eca88026"} Jul 01 22:35:48.855769 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.855609 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 22:30:47 +0000 UTC" deadline="2028-02-17 00:49:27.338646112 +0000 UTC" Jul 01 22:35:48.855769 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.855675 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14282h13m38.48297564s" Jul 01 22:35:48.866569 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:48.866107 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:48.866569 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:48.866225 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:35:49.422188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:49.421398 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:49.422188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:49.421447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:49.422188 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.421591 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:49.422188 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.421674 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret podName:229c282a-5503-4f16-9dd1-48eff34a1972 nodeName:}" failed. No retries permitted until 2026-07-01 22:35:51.42165687 +0000 UTC m=+5.985412153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret") pod "global-pull-secret-syncer-k9f7s" (UID: "229c282a-5503-4f16-9dd1-48eff34a1972") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:49.422188 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.422111 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:49.422188 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.422157 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs podName:9e6b90a5-73e8-4552-b7a3-d2e2b56674f4 nodeName:}" failed. No retries permitted until 2026-07-01 22:35:51.422142768 +0000 UTC m=+5.985898048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs") pod "network-metrics-daemon-r8wqz" (UID: "9e6b90a5-73e8-4552-b7a3-d2e2b56674f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:49.522599 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:49.522565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:49.522776 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.522720 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:35:49.522776 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.522741 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:35:49.522776 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.522752 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qbqhw for pod openshift-network-diagnostics/network-check-target-8hbnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:49.522962 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.522825 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw podName:fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf nodeName:}" failed. No retries permitted until 2026-07-01 22:35:51.522804381 +0000 UTC m=+6.086559673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbqhw" (UniqueName: "kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw") pod "network-check-target-8hbnk" (UID: "fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:49.701141 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:49.701067 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:35:49.856204 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:49.856156 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 22:30:47 +0000 UTC" deadline="2028-03-02 04:10:03.692515477 +0000 UTC" Jul 01 22:35:49.856204 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:49.856196 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14621h34m13.83632419s" Jul 01 22:35:49.868285 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:49.868257 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:49.868476 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.868416 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:35:49.868815 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:49.868771 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:49.868936 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:49.868907 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:35:50.866513 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:50.866433 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:50.867053 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:50.866568 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:35:51.437884 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:51.437132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:51.437884 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:51.437181 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:51.437884 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.437342 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:51.437884 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.437396 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret podName:229c282a-5503-4f16-9dd1-48eff34a1972 nodeName:}" failed. No retries permitted until 2026-07-01 22:35:55.437379265 +0000 UTC m=+10.001134545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret") pod "global-pull-secret-syncer-k9f7s" (UID: "229c282a-5503-4f16-9dd1-48eff34a1972") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:51.437884 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.437785 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:51.437884 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.437853 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs podName:9e6b90a5-73e8-4552-b7a3-d2e2b56674f4 nodeName:}" failed. No retries permitted until 2026-07-01 22:35:55.437837555 +0000 UTC m=+10.001592835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs") pod "network-metrics-daemon-r8wqz" (UID: "9e6b90a5-73e8-4552-b7a3-d2e2b56674f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:51.538634 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:51.538598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:51.538825 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.538747 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:35:51.538825 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.538765 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:35:51.538825 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.538779 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qbqhw for pod openshift-network-diagnostics/network-check-target-8hbnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:51.538994 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.538845 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw podName:fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf nodeName:}" failed. No retries permitted until 2026-07-01 22:35:55.538827669 +0000 UTC m=+10.102582966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbqhw" (UniqueName: "kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw") pod "network-check-target-8hbnk" (UID: "fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:51.866534 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:51.866459 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:51.866990 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:51.866464 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:51.866990 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.866599 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:35:51.866990 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:51.866725 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:35:52.865964 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:52.865750 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:52.865964 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:52.865891 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:35:53.866877 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:53.866842 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:53.867323 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:53.866959 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:35:53.867323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:53.866839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:53.867323 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:53.867035 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:35:54.866071 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:54.865995 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:54.866239 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:54.866120 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:35:55.470195 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:55.470155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:55.470652 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:55.470205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:55.470652 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.470337 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:55.470652 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.470412 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs podName:9e6b90a5-73e8-4552-b7a3-d2e2b56674f4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:03.470392362 +0000 UTC m=+18.034147642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs") pod "network-metrics-daemon-r8wqz" (UID: "9e6b90a5-73e8-4552-b7a3-d2e2b56674f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:35:55.470652 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.470346 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:55.470652 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.470557 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret podName:229c282a-5503-4f16-9dd1-48eff34a1972 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:03.470542896 +0000 UTC m=+18.034298179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret") pod "global-pull-secret-syncer-k9f7s" (UID: "229c282a-5503-4f16-9dd1-48eff34a1972") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:35:55.571401 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:55.570830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:55.571401 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.570984 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:35:55.571401 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.571003 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:35:55.571401 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.571015 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qbqhw for pod openshift-network-diagnostics/network-check-target-8hbnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:55.571401 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.571066 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw podName:fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf nodeName:}" failed. No retries permitted until 2026-07-01 22:36:03.571049812 +0000 UTC m=+18.134805095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbqhw" (UniqueName: "kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw") pod "network-check-target-8hbnk" (UID: "fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:35:55.866656 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:55.866584 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:55.866782 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.866686 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:35:55.867222 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:55.867058 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:55.867222 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:55.867185 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:35:56.867029 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:56.866572 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:56.867029 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:56.866717 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:35:57.865903 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:57.865875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:57.866064 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:57.866022 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:35:57.866242 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:57.866164 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:57.866342 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:57.866274 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:35:58.865955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:58.865923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:35:58.866356 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:58.866029 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:35:59.866392 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:59.866316 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:35:59.866392 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:35:59.866336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:35:59.866827 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:59.866436 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:35:59.866827 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:35:59.866554 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:00.865664 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:00.865630 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:00.865842 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:00.865766 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:01.866432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:01.866209 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:01.866864 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:01.866517 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:01.866864 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:01.866285 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:01.866864 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:01.866765 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:02.866380 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:02.866342 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:02.866552 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:02.866478 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:03.528357 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:03.528332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:03.528357 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:03.528362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:03.528547 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.528448 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:03.528547 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.528459 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:03.528547 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.528499 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret podName:229c282a-5503-4f16-9dd1-48eff34a1972 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:19.528487063 +0000 UTC m=+34.092242340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret") pod "global-pull-secret-syncer-k9f7s" (UID: "229c282a-5503-4f16-9dd1-48eff34a1972") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:03.528547 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.528513 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs podName:9e6b90a5-73e8-4552-b7a3-d2e2b56674f4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:19.528507116 +0000 UTC m=+34.092262392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs") pod "network-metrics-daemon-r8wqz" (UID: "9e6b90a5-73e8-4552-b7a3-d2e2b56674f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:03.629567 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:03.629495 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:03.629696 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.629676 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:36:03.629743 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.629698 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:36:03.629743 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.629708 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qbqhw for pod openshift-network-diagnostics/network-check-target-8hbnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:03.629838 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.629759 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw podName:fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf nodeName:}" failed. No retries permitted until 2026-07-01 22:36:19.629742657 +0000 UTC m=+34.193497952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbqhw" (UniqueName: "kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw") pod "network-check-target-8hbnk" (UID: "fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:03.866618 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:03.866588 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:03.866618 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:03.866612 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:03.867131 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.866871 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:03.867131 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:03.866967 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:04.866526 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:04.866495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:04.866705 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:04.866612 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:05.866724 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:05.866694 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:05.866724 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:05.866718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:05.867215 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:05.866810 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:05.867215 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:05.866905 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:06.866275 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:06.866240 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:06.866436 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:06.866346 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:07.865700 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:07.865681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:07.866068 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:07.865681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:07.866068 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:07.865844 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:07.866068 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:07.865865 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:08.690725 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:08.690699 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pkjrx" event={"ID":"60e99142-dfa9-4b5d-a05d-9de40d049de7","Type":"ContainerStarted","Data":"49b1ad3248c3bf456907afc8546281bfa56940c80ec878eaaa2f853c9ac7e119"} Jul 01 22:36:08.692177 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:08.692155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" event={"ID":"aa14ad09-01a1-4d37-9d6d-f3c8ddcaed09","Type":"ContainerStarted","Data":"de06f149d5a8e2c5ce91c94dc60178bd79af6cf84a5136e354a388d6e95ba3e1"} Jul 01 22:36:08.696915 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:08.696880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerStarted","Data":"bef6a2fcdb8e1f81a2db6ad7234efec48f3abbe9d1f2fca569306fba02649d61"} Jul 01 22:36:08.698409 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:08.698388 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal" event={"ID":"d46c7e440d3290353ae564bd45a93d28","Type":"ContainerStarted","Data":"76f7d20c05c23c3ef3ae147fef595c188ad931c4aa754755f36ff0c783cda291"} Jul 01 22:36:08.710378 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:08.710341 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pkjrx" podStartSLOduration=4.014606524 podStartE2EDuration="23.710330437s" totalImagesPullingTime="19.695723913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:08.710238274 +0000 UTC m=+23.273993572" watchObservedRunningTime="2026-07-01 22:36:08.710330437 +0000 UTC m=+23.274085735" Jul 01 22:36:08.723881 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:08.723846 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-139.ec2.internal" podStartSLOduration=21.723834112 podStartE2EDuration="21.723834112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:08.723597484 +0000 UTC m=+23.287352783" watchObservedRunningTime="2026-07-01 22:36:08.723834112 +0000 UTC m=+23.287589410" Jul 01 22:36:08.866240 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:08.866127 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:08.866815 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:08.866339 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:09.703136 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.702782 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8mfnl" event={"ID":"0ee68d82-2064-4955-b877-5a45fdec1443","Type":"ContainerStarted","Data":"50019500a469ae5b91f6e0b3f35920f5f9b858b38d4c2861ec624b3b7d2bf4e1"} Jul 01 22:36:09.704531 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.704499 2561 generic.go:356] "Generic (PLEG): container finished" podID="336fb92b-16f8-45d9-94c8-56f4589349e9" containerID="02c53cf8fa43b0c69d0c4545db58e84b9053094ba3caa9323c47097c8fc35672" exitCode=0 Jul 01 22:36:09.704668 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.704533 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" event={"ID":"336fb92b-16f8-45d9-94c8-56f4589349e9","Type":"ContainerDied","Data":"02c53cf8fa43b0c69d0c4545db58e84b9053094ba3caa9323c47097c8fc35672"} Jul 01 22:36:09.706261 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.706244 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fphh" event={"ID":"9050c27a-17ba-471f-a3e8-ce4a6886ce5a","Type":"ContainerStarted","Data":"867d995d5d86f8183ef2ef693cbc8402a2d9a4b549a9bc604cc2ceeb6dc005b1"} Jul 01 22:36:09.707947 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.707926 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hhcls" event={"ID":"8be253c7-946e-4e03-a6a9-b93dbb386cdd","Type":"ContainerStarted","Data":"1d0c9ab8537b3b9a451cfeb381b93417488ab9efef73feef0436c1cc71475ac0"} Jul 01 22:36:09.709766 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.709655 2561 generic.go:356] "Generic (PLEG): container finished" podID="4fc85ddde832fe9e23c9298f18b986ba" containerID="6d5f05ab090403077b5ecab73a5af60b5ab8d7c5089732aa2080c305dab2f54f" exitCode=0 Jul 01 22:36:09.709766 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.709733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" event={"ID":"4fc85ddde832fe9e23c9298f18b986ba","Type":"ContainerDied","Data":"6d5f05ab090403077b5ecab73a5af60b5ab8d7c5089732aa2080c305dab2f54f"} Jul 01 22:36:09.711502 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.711482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xg8h2" event={"ID":"88133730-336e-4b16-b84e-d0ec10ab6e57","Type":"ContainerStarted","Data":"609dabea369d8165f329327c5dcb62e732bee87c65c12dbcaca2f03ec15de0db"} Jul 01 22:36:09.713130 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.713108 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" event={"ID":"693a709d-addb-4717-a3e9-451476c44335","Type":"ContainerStarted","Data":"1c2dae3ce01e1db43f949782a693e5f43ebdc5f4c38ae5c6920bce351da87ce5"} Jul 01 22:36:09.716187 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.716172 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgww5_903919bd-c073-460c-b4d3-b0159dfc8e6e/ovn-acl-logging/0.log" Jul 01 22:36:09.716569 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.716545 2561 generic.go:356] "Generic (PLEG): container finished" podID="903919bd-c073-460c-b4d3-b0159dfc8e6e" containerID="2f5264434cf3d190863f19574c2e87d9a280971ae38530d97545509e560d6c47" exitCode=1 Jul 01 22:36:09.716676 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.716639 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerStarted","Data":"677288e8b826f3943fc9583bb3f2e5ec3c38ec2aa792805589ca6c5fe93bc048"} Jul 01 22:36:09.716808 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.716718 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerStarted","Data":"e59a3a204e9a28ece31113140c73a5e6e767f461c17d92bd1a90c38bb0173a34"} Jul 01 22:36:09.716808 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.716754 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerStarted","Data":"356da7bd0d164f9b8579945a936666cf2eed172a12671247cb74e618e8c3c994"} Jul 01 22:36:09.716922 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.716814 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerStarted","Data":"40a5f5226c3fd0d09407a6c02b6df76b9d1c92926407b31b6889c0673ef9db4c"} Jul 01 22:36:09.716922 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.716862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerDied","Data":"2f5264434cf3d190863f19574c2e87d9a280971ae38530d97545509e560d6c47"} Jul 01 22:36:09.734861 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.734818 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8bcsb" podStartSLOduration=5.056530017 podStartE2EDuration="24.734784162s" totalImagesPullingTime="19.678254145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:08.742540346 +0000 UTC m=+23.306295645" watchObservedRunningTime="2026-07-01 22:36:09.734784162 +0000 UTC m=+24.298539455" Jul 01 22:36:09.737954 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.735965 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8mfnl" podStartSLOduration=23.735948054 podStartE2EDuration="23.735948054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-01 22:36:09.734953178 +0000 UTC m=+24.298708480" watchObservedRunningTime="2026-07-01 22:36:09.735948054 +0000 UTC m=+24.299703354" Jul 01 22:36:09.758543 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.758313 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hhcls" podStartSLOduration=4.110738403 podStartE2EDuration="23.758297429s" totalImagesPullingTime="19.647559026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:09.757896945 +0000 UTC m=+24.321652246" watchObservedRunningTime="2026-07-01 22:36:09.758297429 +0000 UTC m=+24.322052740" Jul 01 22:36:09.786238 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.785695 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xg8h2" podStartSLOduration=4.212510819 podStartE2EDuration="23.785678929s" totalImagesPullingTime="19.57316811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:09.785401934 +0000 UTC m=+24.349157234" watchObservedRunningTime="2026-07-01 22:36:09.785678929 +0000 UTC m=+24.349434232" Jul 01 22:36:09.866187 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.865999 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:09.866187 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:09.866124 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:09.866660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.866582 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:09.866718 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:09.866688 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:09.895719 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:09.895678 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6fphh" podStartSLOduration=4.304024852 podStartE2EDuration="23.895661253s" totalImagesPullingTime="19.591636401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:09.848330819 +0000 UTC m=+24.412086120" watchObservedRunningTime="2026-07-01 22:36:09.895661253 +0000 UTC m=+24.459416553" Jul 01 22:36:10.388135 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:10.388108 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 22:36:10.721433 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:10.721352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" event={"ID":"4fc85ddde832fe9e23c9298f18b986ba","Type":"ContainerStarted","Data":"281a05eebe03fed0976d7ea909273fe43505156c31d69e7cf6d4a9cc9ddbedff"} Jul 01 22:36:10.723595 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:10.723563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" event={"ID":"693a709d-addb-4717-a3e9-451476c44335","Type":"ContainerStarted","Data":"8996ff779a598606de75af60b655bb0014d4a211e0a84efb4c1c5d9c070cef7c"} Jul 01 22:36:10.861614 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:10.861447 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T22:36:10.388131443Z","UUID":"f619f610-b96d-4d60-98f9-a94055c8e668","Handler":null,"Name":"","Endpoint":""} Jul 01 22:36:10.864606 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:10.864392 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 22:36:10.864606 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:10.864438 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 22:36:10.866226 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:10.865968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:10.866226 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:10.866184 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:11.729162 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:11.728874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" event={"ID":"693a709d-addb-4717-a3e9-451476c44335","Type":"ContainerStarted","Data":"46a651a08c266be858951962c5a3d9d9d5f3a729bd07aed31aeec51db54b06bc"} Jul 01 22:36:11.732389 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:11.732368 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgww5_903919bd-c073-460c-b4d3-b0159dfc8e6e/ovn-acl-logging/0.log" Jul 01 22:36:11.732821 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:11.732778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerStarted","Data":"4e1adcd2bdbfb97ee66849c13c39908262cf26a6c42b6aec6df77bcbf26fead2"} Jul 01 22:36:11.755372 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:11.755330 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-139.ec2.internal" podStartSLOduration=24.755316555 podStartE2EDuration="24.755316555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:10.745921266 +0000 UTC m=+25.309676565" watchObservedRunningTime="2026-07-01 22:36:11.755316555 +0000 UTC m=+26.319071854" Jul 01 22:36:11.755879 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:11.755765 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6srv" podStartSLOduration=4.140118906 podStartE2EDuration="25.755752757s" totalImagesPullingTime="21.615633851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:11.755451943 +0000 UTC m=+26.319207237" watchObservedRunningTime="2026-07-01 22:36:11.755752757 +0000 UTC m=+26.319508055" Jul 01 22:36:11.865945 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:11.865919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:11.866098 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:11.865969 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:11.866098 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:11.866060 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:11.866214 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:11.866194 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:12.866010 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:12.865980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:12.866405 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:12.866077 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:13.866359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:13.866336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:13.866876 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:13.866455 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:13.866876 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:13.866499 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:13.866876 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:13.866593 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:14.045005 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.044852 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:36:14.045598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.045579 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:36:14.741740 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.741709 2561 generic.go:356] "Generic (PLEG): container finished" podID="336fb92b-16f8-45d9-94c8-56f4589349e9" containerID="d727395778d67cded952e1a97a7d842100533d3fe121540a019eaa90d93b5efe" exitCode=0 Jul 01 22:36:14.741945 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.741804 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" event={"ID":"336fb92b-16f8-45d9-94c8-56f4589349e9","Type":"ContainerDied","Data":"d727395778d67cded952e1a97a7d842100533d3fe121540a019eaa90d93b5efe"} Jul 01 22:36:14.745477 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.745393 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgww5_903919bd-c073-460c-b4d3-b0159dfc8e6e/ovn-acl-logging/0.log" Jul 01 22:36:14.745764 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.745733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerStarted","Data":"35c0419d4b63971c27c14c343567b30badb4c87b3e0ad10bb58ad19b913effda"} Jul 01 22:36:14.745964 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.745946 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:36:14.746172 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.746154 2561 scope.go:117] "RemoveContainer" containerID="2f5264434cf3d190863f19574c2e87d9a280971ae38530d97545509e560d6c47" Jul 01 22:36:14.746473 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.746457 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hhcls" Jul 01 22:36:14.866557 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:14.866528 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:14.866983 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:14.866624 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:15.750888 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.750861 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgww5_903919bd-c073-460c-b4d3-b0159dfc8e6e/ovn-acl-logging/0.log" Jul 01 22:36:15.751225 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.751204 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" event={"ID":"903919bd-c073-460c-b4d3-b0159dfc8e6e","Type":"ContainerStarted","Data":"408c15a4393a0e9d89e539e48c588dd088ca7c393ec9f77cf39c77265e39d384"} Jul 01 22:36:15.751576 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.751555 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:36:15.751708 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.751616 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:36:15.751708 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.751663 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:36:15.765681 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.765659 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:36:15.765809 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.765751 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:36:15.802961 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.802922 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" podStartSLOduration=9.43269516 podStartE2EDuration="29.802909659s" totalImagesPullingTime="20.370214499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:15.798247773 +0000 UTC m=+30.362003071" watchObservedRunningTime="2026-07-01 22:36:15.802909659 +0000 UTC m=+30.366664991" Jul 01 22:36:15.867778 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.867748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:15.868244 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:15.867786 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:15.868244 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:15.867888 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:15.868244 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:15.867954 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:16.755538 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:16.755501 2561 generic.go:356] "Generic (PLEG): container finished" podID="336fb92b-16f8-45d9-94c8-56f4589349e9" containerID="bd1d6098ccfb336d98afbefb707ffb351eb5fe7ee9c18fe9a5a878993791a6e3" exitCode=0 Jul 01 22:36:16.755712 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:16.755581 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" event={"ID":"336fb92b-16f8-45d9-94c8-56f4589349e9","Type":"ContainerDied","Data":"bd1d6098ccfb336d98afbefb707ffb351eb5fe7ee9c18fe9a5a878993791a6e3"} Jul 01 22:36:16.757629 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:16.757610 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8wqz"] Jul 01 22:36:16.757723 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:16.757691 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:16.757782 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:16.757764 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:16.763476 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:16.763445 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8hbnk"] Jul 01 22:36:16.763576 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:16.763521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:16.763636 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:16.763593 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:16.764111 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:16.764091 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k9f7s"] Jul 01 22:36:16.764181 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:16.764165 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:16.764249 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:16.764231 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:17.759509 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:17.759481 2561 generic.go:356] "Generic (PLEG): container finished" podID="336fb92b-16f8-45d9-94c8-56f4589349e9" containerID="01bb16a8905c8b20ce2c685147c975afdf70e5801b50d94facd15842525e8612" exitCode=0 Jul 01 22:36:17.760013 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:17.759584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" event={"ID":"336fb92b-16f8-45d9-94c8-56f4589349e9","Type":"ContainerDied","Data":"01bb16a8905c8b20ce2c685147c975afdf70e5801b50d94facd15842525e8612"} Jul 01 22:36:17.865869 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:17.865843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:17.866039 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:17.866022 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:18.866556 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:18.866471 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:18.867172 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:18.866472 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:18.867172 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:18.866665 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:18.867172 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:18.866751 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:19.553906 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:19.553877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:19.553906 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:19.553912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:19.554104 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:19.554024 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:19.554104 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:19.554079 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret podName:229c282a-5503-4f16-9dd1-48eff34a1972 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:51.554066507 +0000 UTC m=+66.117821789 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret") pod "global-pull-secret-syncer-k9f7s" (UID: "229c282a-5503-4f16-9dd1-48eff34a1972") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:36:19.554209 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:19.554024 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:19.554209 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:19.554192 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs podName:9e6b90a5-73e8-4552-b7a3-d2e2b56674f4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:51.554168683 +0000 UTC m=+66.117923960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs") pod "network-metrics-daemon-r8wqz" (UID: "9e6b90a5-73e8-4552-b7a3-d2e2b56674f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:36:19.654538 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:19.654509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:19.654724 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:19.654705 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:36:19.654815 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:19.654727 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:36:19.654815 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:19.654740 2561 projected.go:196] Error preparing data for projected volume kube-api-access-qbqhw for pod openshift-network-diagnostics/network-check-target-8hbnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:19.654899 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:19.654823 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw podName:fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf nodeName:}" failed. No retries permitted until 2026-07-01 22:36:51.654784804 +0000 UTC m=+66.218540095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbqhw" (UniqueName: "kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw") pod "network-check-target-8hbnk" (UID: "fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:36:19.866211 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:19.866142 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:19.866360 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:19.866292 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hbnk" podUID="fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf" Jul 01 22:36:20.866301 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:20.866272 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:20.866906 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:20.866397 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wqz" podUID="9e6b90a5-73e8-4552-b7a3-d2e2b56674f4" Jul 01 22:36:20.866906 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:20.866430 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:20.866906 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:20.866492 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9f7s" podUID="229c282a-5503-4f16-9dd1-48eff34a1972" Jul 01 22:36:21.186923 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.186840 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-139.ec2.internal" event="NodeReady" Jul 01 22:36:21.187084 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.186988 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 22:36:21.261468 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.261435 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fbbdb466b-sb6dh"] Jul 01 22:36:21.291397 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.291365 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2"] Jul 01 22:36:21.291607 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.291524 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.295197 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.295176 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 22:36:21.295365 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.295183 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 22:36:21.296000 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.295930 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 22:36:21.317015 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.316993 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fbbdb466b-sb6dh"] Jul 01 22:36:21.317096 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.317073 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2" Jul 01 22:36:21.322976 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.322952 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-9wckq"] Jul 01 22:36:21.324895 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.324877 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 22:36:21.339258 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.339237 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xt7xl\"" Jul 01 22:36:21.339346 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.339241 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.341662 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.341642 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2"] Jul 01 22:36:21.341778 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.341674 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b85ls"] Jul 01 22:36:21.341778 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.341761 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.348746 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.348725 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s5g4l\"" Jul 01 22:36:21.352185 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.352166 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.357721 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.357703 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k"] Jul 01 22:36:21.357840 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.357825 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.360470 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.360444 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.360540 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.360484 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 22:36:21.360642 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.360628 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.361641 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.361612 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-p78jg\"" Jul 01 22:36:21.363259 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.363242 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 22:36:21.363607 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.363447 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xzbh\"" Jul 01 22:36:21.367565 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.367540 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 22:36:21.370052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.370021 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj"] Jul 01 22:36:21.370145 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.370131 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.383660 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.383642 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 22:36:21.383755 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.383682 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 22:36:21.383965 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.383942 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.384101 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.384086 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 22:36:21.384170 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.384086 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.384420 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.384407 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4rrhl\"" Jul 01 22:36:21.388321 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.388303 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-9wckq"] Jul 01 22:36:21.388409 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.388392 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.393664 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.393643 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b85ls"] Jul 01 22:36:21.395553 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.395529 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 22:36:21.395553 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.395547 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.396222 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.396078 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 22:36:21.397830 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.397315 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj"] Jul 01 22:36:21.397830 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.397673 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.397830 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.397700 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9t9xc\"" Jul 01 22:36:21.397830 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.397761 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 22:36:21.413300 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.413281 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k"] Jul 01 22:36:21.438840 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.438772 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-kntrj"] Jul 01 22:36:21.453707 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.453687 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.453707 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.453700 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v829d"] Jul 01 22:36:21.456872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.456851 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 22:36:21.457598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.457580 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.461828 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.461782 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 22:36:21.462845 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.462818 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:21.467535 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d81d0a19-3054-4831-967e-e3ee294084a4-tmp-dir\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.467631 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wnd\" (UniqueName: \"kubernetes.io/projected/28aa0edc-b179-4962-97f2-32eb340bff4e-kube-api-access-v4wnd\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.467631 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-image-registry-private-configuration\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.467631 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467608 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-installation-pull-secrets\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.467763 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b4z2\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-kube-api-access-5b4z2\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.467763 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-trusted-ca\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.467763 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28aa0edc-b179-4962-97f2-32eb340bff4e-config\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.467763 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467733 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-bound-sa-token\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.467930 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d81d0a19-3054-4831-967e-e3ee294084a4-config-volume\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.467930 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpmg5\" (UniqueName: \"kubernetes.io/projected/cf1c6459-5adf-471e-8f9d-8fbd758ab16e-kube-api-access-gpmg5\") pod \"volume-data-source-validator-69d9f679db-s68b2\" (UID: \"cf1c6459-5adf-471e-8f9d-8fbd758ab16e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2" Jul 01 22:36:21.467930 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28aa0edc-b179-4962-97f2-32eb340bff4e-trusted-ca\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.467930 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.467930 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-registry-certificates\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.468097 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.467983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28aa0edc-b179-4962-97f2-32eb340bff4e-serving-cert\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.468097 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.468010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s88m\" (UniqueName: \"kubernetes.io/projected/d81d0a19-3054-4831-967e-e3ee294084a4-kube-api-access-6s88m\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.468097 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.468033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.468097 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.468060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d25208c9-002d-47c1-870e-4502c24fe345-ca-trust-extracted\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.470669 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.470651 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 22:36:21.473889 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.473873 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6476b4f77-f6lh9"] Jul 01 22:36:21.473977 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.473914 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x9b57\"" Jul 01 22:36:21.474029 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.473985 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v829d" Jul 01 22:36:21.479721 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.479704 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.481501 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.481478 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-78g8f\"" Jul 01 22:36:21.481600 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.481558 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.481600 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.481583 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 22:36:21.481840 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.481633 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.496520 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.495844 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.496520 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.495920 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-xdsdn"] Jul 01 22:36:21.500089 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.500068 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.500208 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.500087 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 22:36:21.500208 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.500174 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tz2j6\"" Jul 01 22:36:21.500323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.500293 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.500955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.500937 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 22:36:21.501051 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.500988 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 22:36:21.504673 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.504658 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 22:36:21.509751 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.509734 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz"] Jul 01 22:36:21.509912 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.509897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-xdsdn" Jul 01 22:36:21.513039 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.513023 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7wk6n\"" Jul 01 22:36:21.513444 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.513262 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.513593 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.513572 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.530440 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.530421 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4"] Jul 01 22:36:21.530550 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.530516 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:21.533431 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.533410 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dr4wq\"" Jul 01 22:36:21.546898 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.546876 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 22:36:21.546898 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.546891 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.547303 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.547284 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.550080 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.550060 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq"] Jul 01 22:36:21.550204 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.550189 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:21.553576 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.553559 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4kx4f\"" Jul 01 22:36:21.554579 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.554560 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 22:36:21.554781 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.554564 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 22:36:21.554971 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.554953 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 22:36:21.555092 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.555045 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 22:36:21.566099 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.566080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-kntrj"] Jul 01 22:36:21.566178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.566110 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v829d"] Jul 01 22:36:21.566178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.566125 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-xdsdn"] Jul 01 22:36:21.566178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.566156 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz"] Jul 01 22:36:21.566178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.566175 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq"] Jul 01 22:36:21.566178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.566176 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:21.566391 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.566191 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6476b4f77-f6lh9"] Jul 01 22:36:21.566391 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.566217 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4"] Jul 01 22:36:21.568380 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpmg5\" (UniqueName: \"kubernetes.io/projected/cf1c6459-5adf-471e-8f9d-8fbd758ab16e-kube-api-access-gpmg5\") pod \"volume-data-source-validator-69d9f679db-s68b2\" (UID: \"cf1c6459-5adf-471e-8f9d-8fbd758ab16e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2" Jul 01 22:36:21.568480 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw78f\" (UniqueName: \"kubernetes.io/projected/7c079d5a-ede0-43d8-8ee5-c9b778d53386-kube-api-access-vw78f\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.568480 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab-config\") pod \"service-ca-operator-5d7b7dc95c-bln5k\" (UID: \"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.568480 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568452 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76flf\" (UniqueName: \"kubernetes.io/projected/c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab-kube-api-access-76flf\") pod \"service-ca-operator-5d7b7dc95c-bln5k\" (UID: \"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.568621 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.568621 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568593 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-bln5k\" (UID: \"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.568621 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-installation-pull-secrets\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.568746 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568631 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d25208c9-002d-47c1-870e-4502c24fe345-ca-trust-extracted\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.568746 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b4z2\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-kube-api-access-5b4z2\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.568746 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c079d5a-ede0-43d8-8ee5-c9b778d53386-serving-cert\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.568746 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-image-registry-private-configuration\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.568955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c079d5a-ede0-43d8-8ee5-c9b778d53386-tmp\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.568955 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.568781 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:36:21.568955 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.568814 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbbdb466b-sb6dh: secret "image-registry-tls" not found Jul 01 22:36:21.568955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c079d5a-ede0-43d8-8ee5-c9b778d53386-service-ca-bundle\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.568955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzgzx\" (UniqueName: \"kubernetes.io/projected/2eec3495-46ac-42d8-b407-be057f6ae1d7-kube-api-access-pzgzx\") pod \"kube-storage-version-migrator-operator-79964ff6f9-rg4dj\" (UID: \"2eec3495-46ac-42d8-b407-be057f6ae1d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.568955 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.568863 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls podName:d25208c9-002d-47c1-870e-4502c24fe345 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:22.068845747 +0000 UTC m=+36.632601038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls") pod "image-registry-6fbbdb466b-sb6dh" (UID: "d25208c9-002d-47c1-870e-4502c24fe345") : secret "image-registry-tls" not found Jul 01 22:36:21.568955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d81d0a19-3054-4831-967e-e3ee294084a4-config-volume\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.568955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28aa0edc-b179-4962-97f2-32eb340bff4e-trusted-ca\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.568955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-registry-certificates\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.568980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2eec3495-46ac-42d8-b407-be057f6ae1d7-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-rg4dj\" (UID: \"2eec3495-46ac-42d8-b407-be057f6ae1d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c079d5a-ede0-43d8-8ee5-c9b778d53386-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569023 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d25208c9-002d-47c1-870e-4502c24fe345-ca-trust-extracted\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2eec3495-46ac-42d8-b407-be057f6ae1d7-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-rg4dj\" (UID: \"2eec3495-46ac-42d8-b407-be057f6ae1d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28aa0edc-b179-4962-97f2-32eb340bff4e-serving-cert\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s88m\" (UniqueName: \"kubernetes.io/projected/d81d0a19-3054-4831-967e-e3ee294084a4-kube-api-access-6s88m\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7c079d5a-ede0-43d8-8ee5-c9b778d53386-snapshots\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569248 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d81d0a19-3054-4831-967e-e3ee294084a4-tmp-dir\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wnd\" (UniqueName: \"kubernetes.io/projected/28aa0edc-b179-4962-97f2-32eb340bff4e-kube-api-access-v4wnd\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-trusted-ca\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.569359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28aa0edc-b179-4962-97f2-32eb340bff4e-config\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.569918 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-bound-sa-token\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.569918 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.569688 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:36:21.569918 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.569745 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls podName:d81d0a19-3054-4831-967e-e3ee294084a4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:22.069729187 +0000 UTC m=+36.633484482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls") pod "dns-default-b85ls" (UID: "d81d0a19-3054-4831-967e-e3ee294084a4") : secret "dns-default-metrics-tls" not found Jul 01 22:36:21.569918 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.569895 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28aa0edc-b179-4962-97f2-32eb340bff4e-trusted-ca\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.570113 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.570055 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d81d0a19-3054-4831-967e-e3ee294084a4-tmp-dir\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.570218 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.570189 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-registry-certificates\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.570872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.570270 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d81d0a19-3054-4831-967e-e3ee294084a4-config-volume\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.570872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.570418 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 22:36:21.570872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.570542 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dqp6g\"" Jul 01 22:36:21.571079 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.571043 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-trusted-ca\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.571959 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.571936 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28aa0edc-b179-4962-97f2-32eb340bff4e-config\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.574334 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.574170 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28aa0edc-b179-4962-97f2-32eb340bff4e-serving-cert\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.574421 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.574234 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-installation-pull-secrets\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.574421 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.574256 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-image-registry-private-configuration\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.575430 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.575402 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 22:36:21.584893 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.584865 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b4z2\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-kube-api-access-5b4z2\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.585283 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.585261 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s88m\" (UniqueName: \"kubernetes.io/projected/d81d0a19-3054-4831-967e-e3ee294084a4-kube-api-access-6s88m\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:21.585415 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.585380 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpmg5\" (UniqueName: \"kubernetes.io/projected/cf1c6459-5adf-471e-8f9d-8fbd758ab16e-kube-api-access-gpmg5\") pod \"volume-data-source-validator-69d9f679db-s68b2\" (UID: \"cf1c6459-5adf-471e-8f9d-8fbd758ab16e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2" Jul 01 22:36:21.585983 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.585967 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wnd\" (UniqueName: \"kubernetes.io/projected/28aa0edc-b179-4962-97f2-32eb340bff4e-kube-api-access-v4wnd\") pod \"console-operator-7fdbdf9c99-9wckq\" (UID: \"28aa0edc-b179-4962-97f2-32eb340bff4e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.589251 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.589235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-bound-sa-token\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:21.626944 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.626925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2" Jul 01 22:36:21.633771 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.633741 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:21.651253 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.651236 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:21.669978 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.669952 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d557ef6-44e8-41a3-bc26-dcedb2f865bb-cert\") pod \"ingress-canary-v829d\" (UID: \"1d557ef6-44e8-41a3-bc26-dcedb2f865bb\") " pod="openshift-ingress-canary/ingress-canary-v829d" Jul 01 22:36:21.670072 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c079d5a-ede0-43d8-8ee5-c9b778d53386-service-ca-bundle\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.670072 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670032 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzgzx\" (UniqueName: \"kubernetes.io/projected/2eec3495-46ac-42d8-b407-be057f6ae1d7-kube-api-access-pzgzx\") pod \"kube-storage-version-migrator-operator-79964ff6f9-rg4dj\" (UID: \"2eec3495-46ac-42d8-b407-be057f6ae1d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.670072 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd28h\" (UniqueName: \"kubernetes.io/projected/ad82c243-38e9-4439-b86d-da542e92d9ee-kube-api-access-vd28h\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.670214 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:21.670214 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:21.670214 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2eec3495-46ac-42d8-b407-be057f6ae1d7-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-rg4dj\" (UID: \"2eec3495-46ac-42d8-b407-be057f6ae1d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.670214 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.670413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c079d5a-ede0-43d8-8ee5-c9b778d53386-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.670413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2eec3495-46ac-42d8-b407-be057f6ae1d7-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-rg4dj\" (UID: \"2eec3495-46ac-42d8-b407-be057f6ae1d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.670413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7c079d5a-ede0-43d8-8ee5-c9b778d53386-snapshots\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.670413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-stats-auth\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.670604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:21.670604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7sf5\" (UniqueName: \"kubernetes.io/projected/3574edb9-75ad-4739-8762-68ddee0220bf-kube-api-access-d7sf5\") pod \"network-check-source-56499946bc-xdsdn\" (UID: \"3574edb9-75ad-4739-8762-68ddee0220bf\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-xdsdn" Jul 01 22:36:21.670604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:21.670604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-default-certificate\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.670604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670559 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6a883c5-6aff-426a-91a5-cd0072571fab-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:21.670604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670592 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw78f\" (UniqueName: \"kubernetes.io/projected/7c079d5a-ede0-43d8-8ee5-c9b778d53386-kube-api-access-vw78f\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.670894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670609 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c079d5a-ede0-43d8-8ee5-c9b778d53386-service-ca-bundle\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.670894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab-config\") pod \"service-ca-operator-5d7b7dc95c-bln5k\" (UID: \"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.670894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76flf\" (UniqueName: \"kubernetes.io/projected/c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab-kube-api-access-76flf\") pod \"service-ca-operator-5d7b7dc95c-bln5k\" (UID: \"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.670894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670694 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2eec3495-46ac-42d8-b407-be057f6ae1d7-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-rg4dj\" (UID: \"2eec3495-46ac-42d8-b407-be057f6ae1d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.671092 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670906 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.671092 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-bln5k\" (UID: \"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.671092 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.670983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v59gt\" (UniqueName: \"kubernetes.io/projected/1d557ef6-44e8-41a3-bc26-dcedb2f865bb-kube-api-access-v59gt\") pod \"ingress-canary-v829d\" (UID: \"1d557ef6-44e8-41a3-bc26-dcedb2f865bb\") " pod="openshift-ingress-canary/ingress-canary-v829d" Jul 01 22:36:21.671092 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.671042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27sxf\" (UniqueName: \"kubernetes.io/projected/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-kube-api-access-27sxf\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:21.671092 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.671087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c079d5a-ede0-43d8-8ee5-c9b778d53386-serving-cert\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.671308 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.671102 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c079d5a-ede0-43d8-8ee5-c9b778d53386-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.671308 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.671135 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7c079d5a-ede0-43d8-8ee5-c9b778d53386-snapshots\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.671308 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.671146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zclgm\" (UniqueName: \"kubernetes.io/projected/2535e99c-23db-4915-a584-63ea766e1670-kube-api-access-zclgm\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:21.671308 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.671186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c079d5a-ede0-43d8-8ee5-c9b778d53386-tmp\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.671308 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.671299 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab-config\") pod \"service-ca-operator-5d7b7dc95c-bln5k\" (UID: \"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.671539 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.671424 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c079d5a-ede0-43d8-8ee5-c9b778d53386-tmp\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.673373 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.673353 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2eec3495-46ac-42d8-b407-be057f6ae1d7-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-rg4dj\" (UID: \"2eec3495-46ac-42d8-b407-be057f6ae1d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.673566 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.673545 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-bln5k\" (UID: \"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.673688 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.673665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c079d5a-ede0-43d8-8ee5-c9b778d53386-serving-cert\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.685509 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.685490 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76flf\" (UniqueName: \"kubernetes.io/projected/c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab-kube-api-access-76flf\") pod \"service-ca-operator-5d7b7dc95c-bln5k\" (UID: \"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:21.686011 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.685987 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzgzx\" (UniqueName: \"kubernetes.io/projected/2eec3495-46ac-42d8-b407-be057f6ae1d7-kube-api-access-pzgzx\") pod \"kube-storage-version-migrator-operator-79964ff6f9-rg4dj\" (UID: \"2eec3495-46ac-42d8-b407-be057f6ae1d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.697089 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.697034 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw78f\" (UniqueName: \"kubernetes.io/projected/7c079d5a-ede0-43d8-8ee5-c9b778d53386-kube-api-access-vw78f\") pod \"insights-operator-5f67b55555-kntrj\" (UID: \"7c079d5a-ede0-43d8-8ee5-c9b778d53386\") " pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.698767 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.698743 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" Jul 01 22:36:21.764894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.764872 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-kntrj" Jul 01 22:36:21.772084 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v59gt\" (UniqueName: \"kubernetes.io/projected/1d557ef6-44e8-41a3-bc26-dcedb2f865bb-kube-api-access-v59gt\") pod \"ingress-canary-v829d\" (UID: \"1d557ef6-44e8-41a3-bc26-dcedb2f865bb\") " pod="openshift-ingress-canary/ingress-canary-v829d" Jul 01 22:36:21.772168 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27sxf\" (UniqueName: \"kubernetes.io/projected/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-kube-api-access-27sxf\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:21.772168 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zclgm\" (UniqueName: \"kubernetes.io/projected/2535e99c-23db-4915-a584-63ea766e1670-kube-api-access-zclgm\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:21.772168 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d557ef6-44e8-41a3-bc26-dcedb2f865bb-cert\") pod \"ingress-canary-v829d\" (UID: \"1d557ef6-44e8-41a3-bc26-dcedb2f865bb\") " pod="openshift-ingress-canary/ingress-canary-v829d" Jul 01 22:36:21.772257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd28h\" (UniqueName: \"kubernetes.io/projected/ad82c243-38e9-4439-b86d-da542e92d9ee-kube-api-access-vd28h\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.772257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:21.772257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:21.772257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.772438 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.772328 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 22:36:21.772438 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.772395 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert podName:b6a883c5-6aff-426a-91a5-cd0072571fab nodeName:}" failed. No retries permitted until 2026-07-01 22:36:22.272377729 +0000 UTC m=+36.836133012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-xnfcq" (UID: "b6a883c5-6aff-426a-91a5-cd0072571fab") : secret "networking-console-plugin-cert" not found Jul 01 22:36:21.772556 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.772472 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:36:21.772556 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-stats-auth\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.772663 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.772565 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:22.272534634 +0000 UTC m=+36.836289917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : secret "router-metrics-certs-default" not found Jul 01 22:36:21.772663 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:21.772663 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772654 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7sf5\" (UniqueName: \"kubernetes.io/projected/3574edb9-75ad-4739-8762-68ddee0220bf-kube-api-access-d7sf5\") pod \"network-check-source-56499946bc-xdsdn\" (UID: \"3574edb9-75ad-4739-8762-68ddee0220bf\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-xdsdn" Jul 01 22:36:21.772840 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:21.772840 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-default-certificate\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.772840 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.772751 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:36:21.772840 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6a883c5-6aff-426a-91a5-cd0072571fab-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:21.773027 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.772858 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:21.773027 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.772866 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls podName:2535e99c-23db-4915-a584-63ea766e1670 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:22.272848697 +0000 UTC m=+36.836603985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-fcjfz" (UID: "2535e99c-23db-4915-a584-63ea766e1670") : secret "samples-operator-tls" not found Jul 01 22:36:21.773027 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.772916 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls podName:dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:22.272899369 +0000 UTC m=+36.836654671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vv9k4" (UID: "dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:21.773027 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.772958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.773233 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:21.773063 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:22.273046825 +0000 UTC m=+36.836802499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : configmap references non-existent config key: service-ca.crt Jul 01 22:36:21.773233 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.773139 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:21.773443 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.773424 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6a883c5-6aff-426a-91a5-cd0072571fab-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:21.774590 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.774574 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d557ef6-44e8-41a3-bc26-dcedb2f865bb-cert\") pod \"ingress-canary-v829d\" (UID: \"1d557ef6-44e8-41a3-bc26-dcedb2f865bb\") " pod="openshift-ingress-canary/ingress-canary-v829d" Jul 01 22:36:21.774935 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.774919 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-stats-auth\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.774975 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.774945 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-default-certificate\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.798746 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.798721 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v59gt\" (UniqueName: \"kubernetes.io/projected/1d557ef6-44e8-41a3-bc26-dcedb2f865bb-kube-api-access-v59gt\") pod \"ingress-canary-v829d\" (UID: \"1d557ef6-44e8-41a3-bc26-dcedb2f865bb\") " pod="openshift-ingress-canary/ingress-canary-v829d" Jul 01 22:36:21.805143 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.805117 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd28h\" (UniqueName: \"kubernetes.io/projected/ad82c243-38e9-4439-b86d-da542e92d9ee-kube-api-access-vd28h\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:21.806136 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.806117 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27sxf\" (UniqueName: \"kubernetes.io/projected/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-kube-api-access-27sxf\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:21.807460 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.807444 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7sf5\" (UniqueName: \"kubernetes.io/projected/3574edb9-75ad-4739-8762-68ddee0220bf-kube-api-access-d7sf5\") pod \"network-check-source-56499946bc-xdsdn\" (UID: \"3574edb9-75ad-4739-8762-68ddee0220bf\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-xdsdn" Jul 01 22:36:21.818278 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.818245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zclgm\" (UniqueName: \"kubernetes.io/projected/2535e99c-23db-4915-a584-63ea766e1670-kube-api-access-zclgm\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:21.819634 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.819614 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-xdsdn" Jul 01 22:36:21.865914 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.865875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:21.869743 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.869721 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bn4bk\"" Jul 01 22:36:21.979494 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:21.979297 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" Jul 01 22:36:22.047935 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.047914 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-xdsdn"] Jul 01 22:36:22.060430 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.060400 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2"] Jul 01 22:36:22.064752 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:22.061323 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1c6459_5adf_471e_8f9d_8fbd758ab16e.slice/crio-55511d7a7e32ab79d61f760517adcc1e24b0220b4c5e6b8b2566d9c250a4d072 WatchSource:0}: Error finding container 55511d7a7e32ab79d61f760517adcc1e24b0220b4c5e6b8b2566d9c250a4d072: Status 404 returned error can't find the container with id 55511d7a7e32ab79d61f760517adcc1e24b0220b4c5e6b8b2566d9c250a4d072 Jul 01 22:36:22.064752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.064058 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-9wckq"] Jul 01 22:36:22.067067 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.066620 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj"] Jul 01 22:36:22.069476 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:22.069360 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eec3495_46ac_42d8_b407_be057f6ae1d7.slice/crio-1103c388e8e53abada98c5c4d6d2eb12bce0c29a03ac390c59614d66770af10b WatchSource:0}: Error finding container 1103c388e8e53abada98c5c4d6d2eb12bce0c29a03ac390c59614d66770af10b: Status 404 returned error can't find the container with id 1103c388e8e53abada98c5c4d6d2eb12bce0c29a03ac390c59614d66770af10b Jul 01 22:36:22.071693 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.071363 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-kntrj"] Jul 01 22:36:22.073484 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:22.073463 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c079d5a_ede0_43d8_8ee5_c9b778d53386.slice/crio-76e8062145df59984ee4dd078c374ab2b34ae5c31b73e30369057797fa449ddc WatchSource:0}: Error finding container 76e8062145df59984ee4dd078c374ab2b34ae5c31b73e30369057797fa449ddc: Status 404 returned error can't find the container with id 76e8062145df59984ee4dd078c374ab2b34ae5c31b73e30369057797fa449ddc Jul 01 22:36:22.074941 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.074922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:22.075023 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.075010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:22.075088 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.075070 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:36:22.075151 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.075131 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls podName:d81d0a19-3054-4831-967e-e3ee294084a4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:23.075110727 +0000 UTC m=+37.638866020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls") pod "dns-default-b85ls" (UID: "d81d0a19-3054-4831-967e-e3ee294084a4") : secret "dns-default-metrics-tls" not found Jul 01 22:36:22.075194 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.075164 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:36:22.075194 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.075180 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbbdb466b-sb6dh: secret "image-registry-tls" not found Jul 01 22:36:22.075247 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.075221 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls podName:d25208c9-002d-47c1-870e-4502c24fe345 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:23.075209705 +0000 UTC m=+37.638964981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls") pod "image-registry-6fbbdb466b-sb6dh" (UID: "d25208c9-002d-47c1-870e-4502c24fe345") : secret "image-registry-tls" not found Jul 01 22:36:22.085052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.084900 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v829d" Jul 01 22:36:22.222520 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.222496 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k"] Jul 01 22:36:22.265642 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.265614 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v829d"] Jul 01 22:36:22.268248 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:22.268020 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d557ef6_44e8_41a3_bc26_dcedb2f865bb.slice/crio-8fa4df8f5a299a648511bb58ac4849316392af0fed73bc144c786a38bdbf5817 WatchSource:0}: Error finding container 8fa4df8f5a299a648511bb58ac4849316392af0fed73bc144c786a38bdbf5817: Status 404 returned error can't find the container with id 8fa4df8f5a299a648511bb58ac4849316392af0fed73bc144c786a38bdbf5817 Jul 01 22:36:22.268485 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:22.268447 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ce21e3_a7a6_437a_ba5f_ade33dcf1fab.slice/crio-babd1a747423dd215ef5659115ca37b298d82478f219077c53c3ca8005cda5bd WatchSource:0}: Error finding container babd1a747423dd215ef5659115ca37b298d82478f219077c53c3ca8005cda5bd: Status 404 returned error can't find the container with id babd1a747423dd215ef5659115ca37b298d82478f219077c53c3ca8005cda5bd Jul 01 22:36:22.276028 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.276001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:22.276110 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.276057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:22.276110 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.276092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:22.276206 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.276144 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:23.276124525 +0000 UTC m=+37.839879817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : configmap references non-existent config key: service-ca.crt Jul 01 22:36:22.276206 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.276176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:22.276308 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.276204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:22.276308 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.276243 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 22:36:22.276308 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.276278 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:36:22.276308 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.276308 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert podName:b6a883c5-6aff-426a-91a5-cd0072571fab nodeName:}" failed. No retries permitted until 2026-07-01 22:36:23.276287106 +0000 UTC m=+37.840042406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-xnfcq" (UID: "b6a883c5-6aff-426a-91a5-cd0072571fab") : secret "networking-console-plugin-cert" not found Jul 01 22:36:22.276521 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.276330 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls podName:2535e99c-23db-4915-a584-63ea766e1670 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:23.276318353 +0000 UTC m=+37.840073636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-fcjfz" (UID: "2535e99c-23db-4915-a584-63ea766e1670") : secret "samples-operator-tls" not found Jul 01 22:36:22.276521 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.276364 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:22.276521 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.276414 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls podName:dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:23.276400794 +0000 UTC m=+37.840156089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vv9k4" (UID: "dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:22.276521 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.276367 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:36:22.276521 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:22.276458 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:23.276448317 +0000 UTC m=+37.840203596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : secret "router-metrics-certs-default" not found Jul 01 22:36:22.778927 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.778888 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-xdsdn" event={"ID":"3574edb9-75ad-4739-8762-68ddee0220bf","Type":"ContainerStarted","Data":"0a8fccbbbcb6ebba856fc529e6bd61a65b62bb5a77e67771ae6313b8e86f1e6a"} Jul 01 22:36:22.780483 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.780441 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2" event={"ID":"cf1c6459-5adf-471e-8f9d-8fbd758ab16e","Type":"ContainerStarted","Data":"55511d7a7e32ab79d61f760517adcc1e24b0220b4c5e6b8b2566d9c250a4d072"} Jul 01 22:36:22.790965 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.790929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-kntrj" event={"ID":"7c079d5a-ede0-43d8-8ee5-c9b778d53386","Type":"ContainerStarted","Data":"76e8062145df59984ee4dd078c374ab2b34ae5c31b73e30369057797fa449ddc"} Jul 01 22:36:22.792611 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.792553 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" event={"ID":"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab","Type":"ContainerStarted","Data":"babd1a747423dd215ef5659115ca37b298d82478f219077c53c3ca8005cda5bd"} Jul 01 22:36:22.793831 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.793808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" event={"ID":"28aa0edc-b179-4962-97f2-32eb340bff4e","Type":"ContainerStarted","Data":"21c8a3a79eee0798afddd6b9470191c9d522362d12bfc559f1eeb3151bd6e4ca"} Jul 01 22:36:22.795222 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.795186 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" event={"ID":"2eec3495-46ac-42d8-b407-be057f6ae1d7","Type":"ContainerStarted","Data":"1103c388e8e53abada98c5c4d6d2eb12bce0c29a03ac390c59614d66770af10b"} Jul 01 22:36:22.799035 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.799009 2561 generic.go:356] "Generic (PLEG): container finished" podID="336fb92b-16f8-45d9-94c8-56f4589349e9" containerID="4d66cb90ed18d1b124d94dc4232b65969d6528f88963a7166af09efcc82763ff" exitCode=0 Jul 01 22:36:22.799138 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.799078 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" event={"ID":"336fb92b-16f8-45d9-94c8-56f4589349e9","Type":"ContainerDied","Data":"4d66cb90ed18d1b124d94dc4232b65969d6528f88963a7166af09efcc82763ff"} Jul 01 22:36:22.802075 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.802013 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v829d" event={"ID":"1d557ef6-44e8-41a3-bc26-dcedb2f865bb","Type":"ContainerStarted","Data":"8fa4df8f5a299a648511bb58ac4849316392af0fed73bc144c786a38bdbf5817"} Jul 01 22:36:22.867691 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.866574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:22.867691 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.867041 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:22.870235 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.870111 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 22:36:22.870235 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.870118 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hlntg\"" Jul 01 22:36:22.870647 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:22.870489 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 22:36:23.084217 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:23.084187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:23.084381 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:23.084332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:23.084494 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.084477 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:36:23.084564 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.084541 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls podName:d81d0a19-3054-4831-967e-e3ee294084a4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:25.08452312 +0000 UTC m=+39.648278409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls") pod "dns-default-b85ls" (UID: "d81d0a19-3054-4831-967e-e3ee294084a4") : secret "dns-default-metrics-tls" not found Jul 01 22:36:23.084956 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.084940 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:36:23.085036 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.084960 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbbdb466b-sb6dh: secret "image-registry-tls" not found Jul 01 22:36:23.085036 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.085000 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls podName:d25208c9-002d-47c1-870e-4502c24fe345 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:25.084987037 +0000 UTC m=+39.648742316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls") pod "image-registry-6fbbdb466b-sb6dh" (UID: "d25208c9-002d-47c1-870e-4502c24fe345") : secret "image-registry-tls" not found Jul 01 22:36:23.286146 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:23.286059 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:23.286146 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:23.286121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:23.286506 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:23.286192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:23.286506 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:23.286224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:23.286506 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:23.286304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:23.286663 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.286585 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:36:23.286663 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.286661 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 22:36:23.286755 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.286739 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:36:23.286855 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.286830 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:23.286918 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.286877 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:25.286463856 +0000 UTC m=+39.850219140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : configmap references non-existent config key: service-ca.crt Jul 01 22:36:23.286918 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.286900 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:25.286886698 +0000 UTC m=+39.850641979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : secret "router-metrics-certs-default" not found Jul 01 22:36:23.287030 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.286926 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert podName:b6a883c5-6aff-426a-91a5-cd0072571fab nodeName:}" failed. No retries permitted until 2026-07-01 22:36:25.286906897 +0000 UTC m=+39.850662178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-xnfcq" (UID: "b6a883c5-6aff-426a-91a5-cd0072571fab") : secret "networking-console-plugin-cert" not found Jul 01 22:36:23.287030 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.286941 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls podName:2535e99c-23db-4915-a584-63ea766e1670 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:25.286933027 +0000 UTC m=+39.850688309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-fcjfz" (UID: "2535e99c-23db-4915-a584-63ea766e1670") : secret "samples-operator-tls" not found Jul 01 22:36:23.287030 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:23.286954 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls podName:dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:25.286946262 +0000 UTC m=+39.850701544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vv9k4" (UID: "dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:23.817670 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:23.816809 2561 generic.go:356] "Generic (PLEG): container finished" podID="336fb92b-16f8-45d9-94c8-56f4589349e9" containerID="b0030aa49ba24917c19b453098000d905122d93396898ea44725ec9e67192444" exitCode=0 Jul 01 22:36:23.817670 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:23.816884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" event={"ID":"336fb92b-16f8-45d9-94c8-56f4589349e9","Type":"ContainerDied","Data":"b0030aa49ba24917c19b453098000d905122d93396898ea44725ec9e67192444"} Jul 01 22:36:25.104400 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:25.104373 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:25.104906 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:25.104455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:25.104906 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.104559 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:36:25.104906 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.104610 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:36:25.104906 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.104629 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbbdb466b-sb6dh: secret "image-registry-tls" not found Jul 01 22:36:25.104906 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.104629 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls podName:d81d0a19-3054-4831-967e-e3ee294084a4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.104607438 +0000 UTC m=+43.668362714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls") pod "dns-default-b85ls" (UID: "d81d0a19-3054-4831-967e-e3ee294084a4") : secret "dns-default-metrics-tls" not found Jul 01 22:36:25.104906 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.104681 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls podName:d25208c9-002d-47c1-870e-4502c24fe345 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.104666197 +0000 UTC m=+43.668421489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls") pod "image-registry-6fbbdb466b-sb6dh" (UID: "d25208c9-002d-47c1-870e-4502c24fe345") : secret "image-registry-tls" not found Jul 01 22:36:25.306761 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:25.306673 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:25.306929 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:25.306783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:25.306929 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.306845 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:25.306929 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:25.306865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:25.306929 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.306916 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls podName:dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.30689778 +0000 UTC m=+43.870653074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vv9k4" (UID: "dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:25.307148 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.306935 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.306925402 +0000 UTC m=+43.870680680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : configmap references non-existent config key: service-ca.crt Jul 01 22:36:25.307148 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:25.306956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:25.307148 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.306967 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 22:36:25.307148 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.307010 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert podName:b6a883c5-6aff-426a-91a5-cd0072571fab nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.306998185 +0000 UTC m=+43.870753463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-xnfcq" (UID: "b6a883c5-6aff-426a-91a5-cd0072571fab") : secret "networking-console-plugin-cert" not found Jul 01 22:36:25.307148 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:25.307062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:25.307148 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.307073 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:36:25.307148 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.307110 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.307099624 +0000 UTC m=+43.870854928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : secret "router-metrics-certs-default" not found Jul 01 22:36:25.307148 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.307146 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:36:25.307465 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:25.307184 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls podName:2535e99c-23db-4915-a584-63ea766e1670 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:29.30717671 +0000 UTC m=+43.870931987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-fcjfz" (UID: "2535e99c-23db-4915-a584-63ea766e1670") : secret "samples-operator-tls" not found Jul 01 22:36:25.684561 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:25.684530 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:25.783966 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:25.783921 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:26.105432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:26.105392 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:26.236674 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:26.236637 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:26.354087 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:26.354002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:26.471602 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:26.471554 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:26.578259 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:26.578227 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:26.843693 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:26.843628 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:27.183369 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:27.183287 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:27.283982 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:27.283954 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:27.579724 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:27.579648 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:27.697050 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:27.697021 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:28.431810 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:28.431766 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:28.545189 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:28.545163 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:28.858547 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:28.858515 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:28.950150 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:28.950114 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:29.147501 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.147422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:29.147501 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.147501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:29.147734 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.147575 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:36:29.147734 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.147652 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls podName:d81d0a19-3054-4831-967e-e3ee294084a4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:37.1476363 +0000 UTC m=+51.711391590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls") pod "dns-default-b85ls" (UID: "d81d0a19-3054-4831-967e-e3ee294084a4") : secret "dns-default-metrics-tls" not found Jul 01 22:36:29.147734 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.147675 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:36:29.147734 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.147694 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbbdb466b-sb6dh: secret "image-registry-tls" not found Jul 01 22:36:29.147943 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.147756 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls podName:d25208c9-002d-47c1-870e-4502c24fe345 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:37.14773873 +0000 UTC m=+51.711494024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls") pod "image-registry-6fbbdb466b-sb6dh" (UID: "d25208c9-002d-47c1-870e-4502c24fe345") : secret "image-registry-tls" not found Jul 01 22:36:29.349496 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.349461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:29.349638 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.349615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:29.349638 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.349629 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:37.349611579 +0000 UTC m=+51.913366859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : configmap references non-existent config key: service-ca.crt Jul 01 22:36:29.349758 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.349664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:29.349758 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.349710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:29.349758 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.349731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:29.349946 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.349772 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 22:36:29.349946 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.349838 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:36:29.349946 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.349847 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert podName:b6a883c5-6aff-426a-91a5-cd0072571fab nodeName:}" failed. No retries permitted until 2026-07-01 22:36:37.349834583 +0000 UTC m=+51.913589859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-xnfcq" (UID: "b6a883c5-6aff-426a-91a5-cd0072571fab") : secret "networking-console-plugin-cert" not found Jul 01 22:36:29.349946 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.349865 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:29.349946 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.349877 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:36:29.349946 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.349887 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:37.349871098 +0000 UTC m=+51.913626384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : secret "router-metrics-certs-default" not found Jul 01 22:36:29.349946 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.349943 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls podName:dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:37.349927434 +0000 UTC m=+51.913682725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vv9k4" (UID: "dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:29.350289 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:29.349956 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls podName:2535e99c-23db-4915-a584-63ea766e1670 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:37.349949794 +0000 UTC m=+51.913705075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-fcjfz" (UID: "2535e99c-23db-4915-a584-63ea766e1670") : secret "samples-operator-tls" not found Jul 01 22:36:29.834667 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.834637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" event={"ID":"336fb92b-16f8-45d9-94c8-56f4589349e9","Type":"ContainerStarted","Data":"91e640b83616640c01e8fa62633b9eb2f369260dc679e370edd7135f7063867f"} Jul 01 22:36:29.836145 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.836122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2" event={"ID":"cf1c6459-5adf-471e-8f9d-8fbd758ab16e","Type":"ContainerStarted","Data":"1675962c90e0565be1708b2c51ff4135a254615134d62b9379d4e56a93df3ea3"} Jul 01 22:36:29.837722 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.837672 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-kntrj" event={"ID":"7c079d5a-ede0-43d8-8ee5-c9b778d53386","Type":"ContainerStarted","Data":"786c3820d4f3f26048ef108245cf4f11aafe7de882ab17c2203e580f01f84f39"} Jul 01 22:36:29.839550 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.839531 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/0.log" Jul 01 22:36:29.839644 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.839573 2561 generic.go:356] "Generic (PLEG): container finished" podID="28aa0edc-b179-4962-97f2-32eb340bff4e" containerID="dec18ff813007fafd1e6acc0768e76d546e5a89d70b4a8728a3717d5fac98250" exitCode=255 Jul 01 22:36:29.839644 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.839602 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" event={"ID":"28aa0edc-b179-4962-97f2-32eb340bff4e","Type":"ContainerDied","Data":"dec18ff813007fafd1e6acc0768e76d546e5a89d70b4a8728a3717d5fac98250"} Jul 01 22:36:29.839838 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.839821 2561 scope.go:117] "RemoveContainer" containerID="dec18ff813007fafd1e6acc0768e76d546e5a89d70b4a8728a3717d5fac98250" Jul 01 22:36:29.889138 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.889083 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m6hdw" podStartSLOduration=13.648278174 podStartE2EDuration="43.889062652s" totalImagesPullingTime="30.240784478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:29.885908327 +0000 UTC m=+44.449663626" watchObservedRunningTime="2026-07-01 22:36:29.889062652 +0000 UTC m=+44.452817953" Jul 01 22:36:29.985539 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:29.985063 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-kntrj" podStartSLOduration=16.621602548 podStartE2EDuration="23.985042767s" totalImagesPullingTime="7.363440219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:29.943463311 +0000 UTC m=+44.507218611" watchObservedRunningTime="2026-07-01 22:36:29.985042767 +0000 UTC m=+44.548798066" Jul 01 22:36:30.026821 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.026420 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-s68b2" podStartSLOduration=16.691968722 podStartE2EDuration="24.026399975s" totalImagesPullingTime="7.334431253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:30.026002208 +0000 UTC m=+44.589757500" watchObservedRunningTime="2026-07-01 22:36:30.026399975 +0000 UTC m=+44.590155276" Jul 01 22:36:30.176655 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.176625 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:30.326354 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.326281 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:30.576728 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.576653 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:30.701053 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.701020 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:30.846108 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.846029 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" event={"ID":"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab","Type":"ContainerStarted","Data":"672f54f5afdda4016ab0ac07fc9f764ee0b206e1c7ec5af781a06dfd506d2a6f"} Jul 01 22:36:30.847773 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.847751 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/1.log" Jul 01 22:36:30.848244 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.848223 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/0.log" Jul 01 22:36:30.848312 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.848266 2561 generic.go:356] "Generic (PLEG): container finished" podID="28aa0edc-b179-4962-97f2-32eb340bff4e" containerID="8a3d9ceb48ff8a49d4ca5d302df01886551474e56c1bc049e4cdeddcd6a4f974" exitCode=255 Jul 01 22:36:30.848370 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.848349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" event={"ID":"28aa0edc-b179-4962-97f2-32eb340bff4e","Type":"ContainerDied","Data":"8a3d9ceb48ff8a49d4ca5d302df01886551474e56c1bc049e4cdeddcd6a4f974"} Jul 01 22:36:30.848450 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.848406 2561 scope.go:117] "RemoveContainer" containerID="dec18ff813007fafd1e6acc0768e76d546e5a89d70b4a8728a3717d5fac98250" Jul 01 22:36:30.848678 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.848615 2561 scope.go:117] "RemoveContainer" containerID="8a3d9ceb48ff8a49d4ca5d302df01886551474e56c1bc049e4cdeddcd6a4f974" Jul 01 22:36:30.848819 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:30.848779 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9wckq_openshift-console-operator(28aa0edc-b179-4962-97f2-32eb340bff4e)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" podUID="28aa0edc-b179-4962-97f2-32eb340bff4e" Jul 01 22:36:30.850447 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.850286 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" event={"ID":"2eec3495-46ac-42d8-b407-be057f6ae1d7","Type":"ContainerStarted","Data":"d277bb00437b1090d8b1038038d054f78c00faa1319f5871f4c60d83c8504033"} Jul 01 22:36:30.851804 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.851772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v829d" event={"ID":"1d557ef6-44e8-41a3-bc26-dcedb2f865bb","Type":"ContainerStarted","Data":"ead5ee4d5c687ac3044306cf5248919d920f30683ad81d5396bced9e5d6b01c0"} Jul 01 22:36:30.853544 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.853517 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-xdsdn" event={"ID":"3574edb9-75ad-4739-8762-68ddee0220bf","Type":"ContainerStarted","Data":"8566a982ee486f96eef7f339ecd3c7a65ae3c1b8921bdf8961850c041811a831"} Jul 01 22:36:30.922723 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.922678 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" podStartSLOduration=17.745511336 podStartE2EDuration="24.922662078s" totalImagesPullingTime="7.177150742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:30.921537676 +0000 UTC m=+45.485292976" watchObservedRunningTime="2026-07-01 22:36:30.922662078 +0000 UTC m=+45.486417377" Jul 01 22:36:30.978728 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:30.978676 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" podStartSLOduration=17.609648391 podStartE2EDuration="24.978657504s" totalImagesPullingTime="7.369009113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:30.978450302 +0000 UTC m=+45.542205602" watchObservedRunningTime="2026-07-01 22:36:30.978657504 +0000 UTC m=+45.542412805" Jul 01 22:36:31.026457 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.026403 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-xdsdn" podStartSLOduration=17.640445765 podStartE2EDuration="25.026381783s" totalImagesPullingTime="7.385936018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:31.025712558 +0000 UTC m=+45.589467857" watchObservedRunningTime="2026-07-01 22:36:31.026381783 +0000 UTC m=+45.590137083" Jul 01 22:36:31.091689 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.091643 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v829d" podStartSLOduration=2.589260981 podStartE2EDuration="10.091626707s" totalImagesPullingTime="7.502365726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:31.089842283 +0000 UTC m=+45.653597583" watchObservedRunningTime="2026-07-01 22:36:31.091626707 +0000 UTC m=+45.655382005" Jul 01 22:36:31.285180 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.285150 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bb8hk"] Jul 01 22:36:31.315620 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.315595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.337102 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.337055 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 22:36:31.337102 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.337065 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 22:36:31.337290 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.337140 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5qzdt\"" Jul 01 22:36:31.343604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.343584 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bb8hk"] Jul 01 22:36:31.365355 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.365333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/382757d3-0804-4b97-88c7-ecd21d46cc13-crio-socket\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.365459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.365372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.365514 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.365484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.365560 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.365527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2zn8\" (UniqueName: \"kubernetes.io/projected/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-api-access-f2zn8\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.365596 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.365563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/382757d3-0804-4b97-88c7-ecd21d46cc13-data-volume\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.466340 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.466313 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zn8\" (UniqueName: \"kubernetes.io/projected/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-api-access-f2zn8\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.466449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.466344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/382757d3-0804-4b97-88c7-ecd21d46cc13-data-volume\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.466449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.466434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/382757d3-0804-4b97-88c7-ecd21d46cc13-crio-socket\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.466521 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.466476 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.466594 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.466578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.466647 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.466583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/382757d3-0804-4b97-88c7-ecd21d46cc13-crio-socket\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.466702 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:31.466632 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 22:36:31.466702 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:31.466695 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm podName:382757d3-0804-4b97-88c7-ecd21d46cc13 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:31.966676612 +0000 UTC m=+46.530431889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bb8hk" (UID: "382757d3-0804-4b97-88c7-ecd21d46cc13") : configmap "kube-rbac-proxy" not found Jul 01 22:36:31.466855 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:31.466701 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:36:31.466855 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.466716 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/382757d3-0804-4b97-88c7-ecd21d46cc13-data-volume\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.466855 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:31.466759 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls podName:382757d3-0804-4b97-88c7-ecd21d46cc13 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:31.966741509 +0000 UTC m=+46.530496804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bb8hk" (UID: "382757d3-0804-4b97-88c7-ecd21d46cc13") : secret "insights-runtime-extractor-tls" not found Jul 01 22:36:31.484936 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.484909 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:31.501849 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.501829 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zn8\" (UniqueName: \"kubernetes.io/projected/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-api-access-f2zn8\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.651833 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.651746 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:31.651833 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.651810 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:31.705423 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.705392 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:31.850032 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.850001 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:31.858008 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.857987 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/1.log" Jul 01 22:36:31.858342 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.858325 2561 scope.go:117] "RemoveContainer" containerID="8a3d9ceb48ff8a49d4ca5d302df01886551474e56c1bc049e4cdeddcd6a4f974" Jul 01 22:36:31.858505 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:31.858484 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9wckq_openshift-console-operator(28aa0edc-b179-4962-97f2-32eb340bff4e)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" podUID="28aa0edc-b179-4962-97f2-32eb340bff4e" Jul 01 22:36:31.969870 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.969847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.969999 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:31.969898 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 22:36:31.970065 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:31.970017 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm podName:382757d3-0804-4b97-88c7-ecd21d46cc13 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:32.969997676 +0000 UTC m=+47.533752958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bb8hk" (UID: "382757d3-0804-4b97-88c7-ecd21d46cc13") : configmap "kube-rbac-proxy" not found Jul 01 22:36:31.970128 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:31.970094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:31.970234 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:31.970217 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:36:31.970296 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:31.970275 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls podName:382757d3-0804-4b97-88c7-ecd21d46cc13 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:32.970260247 +0000 UTC m=+47.534015532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bb8hk" (UID: "382757d3-0804-4b97-88c7-ecd21d46cc13") : secret "insights-runtime-extractor-tls" not found Jul 01 22:36:32.070387 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:32.070359 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:32.276509 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:32.276427 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:32.862495 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:32.862459 2561 scope.go:117] "RemoveContainer" containerID="8a3d9ceb48ff8a49d4ca5d302df01886551474e56c1bc049e4cdeddcd6a4f974" Jul 01 22:36:32.862951 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:32.862665 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9wckq_openshift-console-operator(28aa0edc-b179-4962-97f2-32eb340bff4e)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" podUID="28aa0edc-b179-4962-97f2-32eb340bff4e" Jul 01 22:36:32.954439 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:32.954414 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xg8h2_88133730-336e-4b16-b84e-d0ec10ab6e57/dns-node-resolver/0.log" Jul 01 22:36:32.978996 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:32.978967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:32.979107 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:32.979028 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 22:36:32.979107 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:32.979096 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm podName:382757d3-0804-4b97-88c7-ecd21d46cc13 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:34.979078656 +0000 UTC m=+49.542833947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bb8hk" (UID: "382757d3-0804-4b97-88c7-ecd21d46cc13") : configmap "kube-rbac-proxy" not found Jul 01 22:36:32.979240 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:32.979120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:32.979322 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:32.979303 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:36:32.979376 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:32.979369 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls podName:382757d3-0804-4b97-88c7-ecd21d46cc13 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:34.979353619 +0000 UTC m=+49.543108913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bb8hk" (UID: "382757d3-0804-4b97-88c7-ecd21d46cc13") : secret "insights-runtime-extractor-tls" not found Jul 01 22:36:33.773771 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:33.773742 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fphh_9050c27a-17ba-471f-a3e8-ce4a6886ce5a/node-ca/0.log" Jul 01 22:36:33.865553 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:33.865523 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:33.999633 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:33.999603 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:34.360773 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:34.360748 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v829d_1d557ef6-44e8-41a3-bc26-dcedb2f865bb/serve-healthcheck-canary/0.log" Jul 01 22:36:34.993972 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:34.993940 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:34.994331 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:34.994068 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 22:36:34.994331 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:34.994084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:34.994331 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:34.994138 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm podName:382757d3-0804-4b97-88c7-ecd21d46cc13 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:38.994122474 +0000 UTC m=+53.557877750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bb8hk" (UID: "382757d3-0804-4b97-88c7-ecd21d46cc13") : configmap "kube-rbac-proxy" not found Jul 01 22:36:34.994331 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:34.994254 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:36:34.994331 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:34.994327 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls podName:382757d3-0804-4b97-88c7-ecd21d46cc13 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:38.994310262 +0000 UTC m=+53.558065557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bb8hk" (UID: "382757d3-0804-4b97-88c7-ecd21d46cc13") : secret "insights-runtime-extractor-tls" not found Jul 01 22:36:36.008024 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:36.007989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:37.211958 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.211923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:37.212311 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.212028 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:37.212311 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.212084 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:36:37.212311 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.212147 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls podName:d81d0a19-3054-4831-967e-e3ee294084a4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:53.212129681 +0000 UTC m=+67.775884980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls") pod "dns-default-b85ls" (UID: "d81d0a19-3054-4831-967e-e3ee294084a4") : secret "dns-default-metrics-tls" not found Jul 01 22:36:37.212311 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.212162 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:36:37.212311 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.212179 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbbdb466b-sb6dh: secret "image-registry-tls" not found Jul 01 22:36:37.212311 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.212223 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls podName:d25208c9-002d-47c1-870e-4502c24fe345 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:53.212209015 +0000 UTC m=+67.775964291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls") pod "image-registry-6fbbdb466b-sb6dh" (UID: "d25208c9-002d-47c1-870e-4502c24fe345") : secret "image-registry-tls" not found Jul 01 22:36:37.338406 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.338377 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:37.413654 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.413629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:37.413766 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.413659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:37.413844 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.413762 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:36:37.413844 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.413785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:37.413844 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.413830 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:53.413818074 +0000 UTC m=+67.977573353 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : secret "router-metrics-certs-default" not found Jul 01 22:36:37.413950 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.413763 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 22:36:37.413950 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.413858 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:36:37.413950 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.413873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:37.413950 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.413902 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls podName:2535e99c-23db-4915-a584-63ea766e1670 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:53.413889278 +0000 UTC m=+67.977644569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-fcjfz" (UID: "2535e99c-23db-4915-a584-63ea766e1670") : secret "samples-operator-tls" not found Jul 01 22:36:37.413950 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.413933 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:37.414097 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.413969 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls podName:dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:53.4139586 +0000 UTC m=+67.977713880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vv9k4" (UID: "dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:36:37.414097 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.413994 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert podName:b6a883c5-6aff-426a-91a5-cd0072571fab nodeName:}" failed. No retries permitted until 2026-07-01 22:36:53.413984604 +0000 UTC m=+67.977739886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-xnfcq" (UID: "b6a883c5-6aff-426a-91a5-cd0072571fab") : secret "networking-console-plugin-cert" not found Jul 01 22:36:37.414097 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.414030 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:37.414225 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:37.414143 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle podName:ad82c243-38e9-4439-b86d-da542e92d9ee nodeName:}" failed. No retries permitted until 2026-07-01 22:36:53.414131284 +0000 UTC m=+67.977886579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle") pod "router-default-6476b4f77-f6lh9" (UID: "ad82c243-38e9-4439-b86d-da542e92d9ee") : configmap references non-existent config key: service-ca.crt Jul 01 22:36:37.803598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.803558 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:37.914883 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:37.914855 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:38.521993 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:38.521962 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:38.690068 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:38.690038 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:38.906274 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:38.906202 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:39.027315 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:39.027283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:39.027471 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:39.027373 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:39.027510 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:39.027477 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:36:39.027552 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:39.027543 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls podName:382757d3-0804-4b97-88c7-ecd21d46cc13 nodeName:}" failed. No retries permitted until 2026-07-01 22:36:47.027526626 +0000 UTC m=+61.591281925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bb8hk" (UID: "382757d3-0804-4b97-88c7-ecd21d46cc13") : secret "insights-runtime-extractor-tls" not found Jul 01 22:36:39.027782 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:39.027765 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/382757d3-0804-4b97-88c7-ecd21d46cc13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:39.156519 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:39.156433 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:39.280069 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:39.280038 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:39.996097 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:39.996064 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:40.386002 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:40.385918 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:40.773836 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:40.773812 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:41.176541 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:41.176467 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:41.410184 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:41.410155 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:41.765772 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:41.765745 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:41.927765 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:41.927733 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:42.177633 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:42.177559 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:42.371201 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:42.371171 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:42.527140 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:42.527110 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:42.631901 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:42.631871 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:43.154655 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:43.154623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:43.293689 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:43.293659 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:43.381121 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:43.381090 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:43.964702 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:43.964669 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:44.360543 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:44.360468 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:44.769129 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:44.769098 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:45.135438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:45.135353 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:45.225428 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:45.225396 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:45.552248 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:45.552219 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:45.946982 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:45.946905 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:46.345709 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:46.345669 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:46.549240 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:46.549212 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:46.850907 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:46.850879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:47.097907 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.097875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:47.100140 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.100103 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/382757d3-0804-4b97-88c7-ecd21d46cc13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bb8hk\" (UID: \"382757d3-0804-4b97-88c7-ecd21d46cc13\") " pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:47.209675 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.209647 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:47.227613 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.227589 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5qzdt\"" Jul 01 22:36:47.234748 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.234731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bb8hk" Jul 01 22:36:47.361913 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.361887 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bb8hk"] Jul 01 22:36:47.363324 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.363298 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:47.364416 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:47.364389 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382757d3_0804_4b97_88c7_ecd21d46cc13.slice/crio-a4c2219b235073ef0638f1f26bf9497b9495cfb86a78a239b6d498df91588313 WatchSource:0}: Error finding container a4c2219b235073ef0638f1f26bf9497b9495cfb86a78a239b6d498df91588313: Status 404 returned error can't find the container with id a4c2219b235073ef0638f1f26bf9497b9495cfb86a78a239b6d498df91588313 Jul 01 22:36:47.771665 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.771638 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgww5" Jul 01 22:36:47.867228 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.867061 2561 scope.go:117] "RemoveContainer" containerID="8a3d9ceb48ff8a49d4ca5d302df01886551474e56c1bc049e4cdeddcd6a4f974" Jul 01 22:36:47.922853 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:47.922825 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bb8hk" event={"ID":"382757d3-0804-4b97-88c7-ecd21d46cc13","Type":"ContainerStarted","Data":"a4c2219b235073ef0638f1f26bf9497b9495cfb86a78a239b6d498df91588313"} Jul 01 22:36:48.002591 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.002548 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:48.153783 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.153745 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:48.384280 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.384201 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:48.928108 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.928079 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/2.log" Jul 01 22:36:48.928559 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.928542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/1.log" Jul 01 22:36:48.928688 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.928582 2561 generic.go:356] "Generic (PLEG): container finished" podID="28aa0edc-b179-4962-97f2-32eb340bff4e" containerID="96dd4ca75b28aa97611e7b45032cbb69d69151d1ee7382fd5dd133e2ae7f4e26" exitCode=255 Jul 01 22:36:48.928688 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.928643 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" event={"ID":"28aa0edc-b179-4962-97f2-32eb340bff4e","Type":"ContainerDied","Data":"96dd4ca75b28aa97611e7b45032cbb69d69151d1ee7382fd5dd133e2ae7f4e26"} Jul 01 22:36:48.928811 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.928703 2561 scope.go:117] "RemoveContainer" containerID="8a3d9ceb48ff8a49d4ca5d302df01886551474e56c1bc049e4cdeddcd6a4f974" Jul 01 22:36:48.929037 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.929018 2561 scope.go:117] "RemoveContainer" containerID="96dd4ca75b28aa97611e7b45032cbb69d69151d1ee7382fd5dd133e2ae7f4e26" Jul 01 22:36:48.929254 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:48.929232 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9wckq_openshift-console-operator(28aa0edc-b179-4962-97f2-32eb340bff4e)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" podUID="28aa0edc-b179-4962-97f2-32eb340bff4e" Jul 01 22:36:48.992999 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:48.992973 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:49.196089 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:49.196018 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:51.638818 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.638725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:51.639166 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.638832 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:51.641288 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.641268 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 22:36:51.641402 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.641272 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 22:36:51.651361 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.651334 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:51.651450 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.651393 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:36:51.651536 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.651520 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/229c282a-5503-4f16-9dd1-48eff34a1972-original-pull-secret\") pod \"global-pull-secret-syncer-k9f7s\" (UID: \"229c282a-5503-4f16-9dd1-48eff34a1972\") " pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:51.651678 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.651662 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6b90a5-73e8-4552-b7a3-d2e2b56674f4-metrics-certs\") pod \"network-metrics-daemon-r8wqz\" (UID: \"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4\") " pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:51.651761 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.651750 2561 scope.go:117] "RemoveContainer" containerID="96dd4ca75b28aa97611e7b45032cbb69d69151d1ee7382fd5dd133e2ae7f4e26" Jul 01 22:36:51.651924 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:36:51.651907 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9wckq_openshift-console-operator(28aa0edc-b179-4962-97f2-32eb340bff4e)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" podUID="28aa0edc-b179-4962-97f2-32eb340bff4e" Jul 01 22:36:51.684879 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.684853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9f7s" Jul 01 22:36:51.696270 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.696253 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hlntg\"" Jul 01 22:36:51.704286 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.704272 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wqz" Jul 01 22:36:51.739705 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.739534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:51.743349 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.743327 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbqhw\" (UniqueName: \"kubernetes.io/projected/fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf-kube-api-access-qbqhw\") pod \"network-check-target-8hbnk\" (UID: \"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf\") " pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:51.843494 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.843470 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k9f7s"] Jul 01 22:36:51.845933 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:51.845906 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229c282a_5503_4f16_9dd1_48eff34a1972.slice/crio-47ee4288a102ac274bb125178f1e5ab59879dbdaa9b7e538e5439388a3442895 WatchSource:0}: Error finding container 47ee4288a102ac274bb125178f1e5ab59879dbdaa9b7e538e5439388a3442895: Status 404 returned error can't find the container with id 47ee4288a102ac274bb125178f1e5ab59879dbdaa9b7e538e5439388a3442895 Jul 01 22:36:51.874922 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.874897 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8wqz"] Jul 01 22:36:51.877680 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.877658 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bn4bk\"" Jul 01 22:36:51.877842 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:51.877821 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6b90a5_73e8_4552_b7a3_d2e2b56674f4.slice/crio-66288aa40a137513163b9c0cb909956c256ef748e780b1afe334f06a17a3416d WatchSource:0}: Error finding container 66288aa40a137513163b9c0cb909956c256ef748e780b1afe334f06a17a3416d: Status 404 returned error can't find the container with id 66288aa40a137513163b9c0cb909956c256ef748e780b1afe334f06a17a3416d Jul 01 22:36:51.885120 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.885103 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:51.941293 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.941262 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bb8hk" event={"ID":"382757d3-0804-4b97-88c7-ecd21d46cc13","Type":"ContainerStarted","Data":"fb4d3498a6f9c9ca81a4009ad39631ed5c7f91fa2760be3a4ad865304f0f1cab"} Jul 01 22:36:51.942785 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.942754 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8wqz" event={"ID":"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4","Type":"ContainerStarted","Data":"66288aa40a137513163b9c0cb909956c256ef748e780b1afe334f06a17a3416d"} Jul 01 22:36:51.945398 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.944829 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k9f7s" event={"ID":"229c282a-5503-4f16-9dd1-48eff34a1972","Type":"ContainerStarted","Data":"47ee4288a102ac274bb125178f1e5ab59879dbdaa9b7e538e5439388a3442895"} Jul 01 22:36:51.948145 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:51.948050 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/2.log" Jul 01 22:36:52.023907 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:52.023879 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8hbnk"] Jul 01 22:36:52.026312 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:52.026291 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1a498a_3f4e_4ffc_a8e4_e30f9101f2bf.slice/crio-c2905a0c45d25a8619b3767db7aec39413a19879063fccae946b5876dc24a16d WatchSource:0}: Error finding container c2905a0c45d25a8619b3767db7aec39413a19879063fccae946b5876dc24a16d: Status 404 returned error can't find the container with id c2905a0c45d25a8619b3767db7aec39413a19879063fccae946b5876dc24a16d Jul 01 22:36:52.954046 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:52.954016 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bb8hk" event={"ID":"382757d3-0804-4b97-88c7-ecd21d46cc13","Type":"ContainerStarted","Data":"c7dc9355dd557340a6d58fc6bfe15f7af3ee771b466dc779855d82ca37a907fc"} Jul 01 22:36:52.955739 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:52.955698 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8hbnk" event={"ID":"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf","Type":"ContainerStarted","Data":"1ae2e8ffd707f1b0bca5711c6da5040257da5025484e77403500c5e044006d61"} Jul 01 22:36:52.955850 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:52.955761 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8hbnk" event={"ID":"fb1a498a-3f4e-4ffc-a8e4-e30f9101f2bf","Type":"ContainerStarted","Data":"c2905a0c45d25a8619b3767db7aec39413a19879063fccae946b5876dc24a16d"} Jul 01 22:36:52.955920 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:52.955859 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:36:53.002142 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.002097 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8hbnk" podStartSLOduration=67.002077575 podStartE2EDuration="1m7.002077575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:53.001894074 +0000 UTC m=+67.565649374" watchObservedRunningTime="2026-07-01 22:36:53.002077575 +0000 UTC m=+67.565832876" Jul 01 22:36:53.250955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.250869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:53.251123 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.250967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:53.253706 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.253674 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d81d0a19-3054-4831-967e-e3ee294084a4-metrics-tls\") pod \"dns-default-b85ls\" (UID: \"d81d0a19-3054-4831-967e-e3ee294084a4\") " pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:53.253843 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.253714 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"image-registry-6fbbdb466b-sb6dh\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:53.405861 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.405819 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s5g4l\"" Jul 01 22:36:53.413911 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.413858 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:53.453111 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.452557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:53.453111 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.452614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:53.453111 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.452665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:53.453111 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.452727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:53.453111 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.452759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:53.453653 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.453528 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad82c243-38e9-4439-b86d-da542e92d9ee-service-ca-bundle\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:53.456040 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.456011 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6a883c5-6aff-426a-91a5-cd0072571fab-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-xnfcq\" (UID: \"b6a883c5-6aff-426a-91a5-cd0072571fab\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:53.456645 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.456483 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2535e99c-23db-4915-a584-63ea766e1670-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-fcjfz\" (UID: \"2535e99c-23db-4915-a584-63ea766e1670\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:53.456645 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.456601 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad82c243-38e9-4439-b86d-da542e92d9ee-metrics-certs\") pod \"router-default-6476b4f77-f6lh9\" (UID: \"ad82c243-38e9-4439-b86d-da542e92d9ee\") " pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:53.457178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.457130 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vv9k4\" (UID: \"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:53.471368 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.471344 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xzbh\"" Jul 01 22:36:53.479399 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.479376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b85ls" Jul 01 22:36:53.579330 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.579286 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fbbdb466b-sb6dh"] Jul 01 22:36:53.582842 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:53.582812 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25208c9_002d_47c1_870e_4502c24fe345.slice/crio-3a00f9f18a4bf416dd4a37b1a839a3401bdede271c7c72e54aa5b47a478e7556 WatchSource:0}: Error finding container 3a00f9f18a4bf416dd4a37b1a839a3401bdede271c7c72e54aa5b47a478e7556: Status 404 returned error can't find the container with id 3a00f9f18a4bf416dd4a37b1a839a3401bdede271c7c72e54aa5b47a478e7556 Jul 01 22:36:53.608768 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.608743 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tz2j6\"" Jul 01 22:36:53.617107 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.617082 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:53.645831 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.644864 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dr4wq\"" Jul 01 22:36:53.645831 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.645661 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b85ls"] Jul 01 22:36:53.652986 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.652521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" Jul 01 22:36:53.652986 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:53.652770 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd81d0a19_3054_4831_967e_e3ee294084a4.slice/crio-e054361f60b0f990bd211dd186aff4327a559516c635445c0d7234f44fb5d700 WatchSource:0}: Error finding container e054361f60b0f990bd211dd186aff4327a559516c635445c0d7234f44fb5d700: Status 404 returned error can't find the container with id e054361f60b0f990bd211dd186aff4327a559516c635445c0d7234f44fb5d700 Jul 01 22:36:53.662594 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.662577 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4kx4f\"" Jul 01 22:36:53.671161 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.671140 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" Jul 01 22:36:53.687076 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.687055 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dqp6g\"" Jul 01 22:36:53.695227 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.695205 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" Jul 01 22:36:53.848184 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.847204 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6476b4f77-f6lh9"] Jul 01 22:36:53.853894 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:53.853869 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad82c243_38e9_4439_b86d_da542e92d9ee.slice/crio-b4f738e38598cc7929e6cd58417edbbacddfcdae0ea705909bda2c8abb048f55 WatchSource:0}: Error finding container b4f738e38598cc7929e6cd58417edbbacddfcdae0ea705909bda2c8abb048f55: Status 404 returned error can't find the container with id b4f738e38598cc7929e6cd58417edbbacddfcdae0ea705909bda2c8abb048f55 Jul 01 22:36:53.887248 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.887141 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz"] Jul 01 22:36:53.939818 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.939353 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4"] Jul 01 22:36:53.944157 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:53.944127 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec17bdc_1d33_4d3d_b1ca_f353f8b91bc4.slice/crio-37a6d60905e83b49e8e422195363e0632e2cff49204e11e2c82cff20c2585124 WatchSource:0}: Error finding container 37a6d60905e83b49e8e422195363e0632e2cff49204e11e2c82cff20c2585124: Status 404 returned error can't find the container with id 37a6d60905e83b49e8e422195363e0632e2cff49204e11e2c82cff20c2585124 Jul 01 22:36:53.952722 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.952632 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq"] Jul 01 22:36:53.956565 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:36:53.956538 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a883c5_6aff_426a_91a5_cd0072571fab.slice/crio-88a86266193b4e21b92176b27bee485d7599132fc92fa5e5d722db32a5a03060 WatchSource:0}: Error finding container 88a86266193b4e21b92176b27bee485d7599132fc92fa5e5d722db32a5a03060: Status 404 returned error can't find the container with id 88a86266193b4e21b92176b27bee485d7599132fc92fa5e5d722db32a5a03060 Jul 01 22:36:53.963223 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.963112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" event={"ID":"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4","Type":"ContainerStarted","Data":"37a6d60905e83b49e8e422195363e0632e2cff49204e11e2c82cff20c2585124"} Jul 01 22:36:53.966344 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.966319 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6476b4f77-f6lh9" event={"ID":"ad82c243-38e9-4439-b86d-da542e92d9ee","Type":"ContainerStarted","Data":"9e8aac801b89b66a2ae94b091ee21f02cae232da672e50563a7f72cb2a0cd42c"} Jul 01 22:36:53.966533 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.966514 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6476b4f77-f6lh9" event={"ID":"ad82c243-38e9-4439-b86d-da542e92d9ee","Type":"ContainerStarted","Data":"b4f738e38598cc7929e6cd58417edbbacddfcdae0ea705909bda2c8abb048f55"} Jul 01 22:36:53.968309 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.968240 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b85ls" event={"ID":"d81d0a19-3054-4831-967e-e3ee294084a4","Type":"ContainerStarted","Data":"e054361f60b0f990bd211dd186aff4327a559516c635445c0d7234f44fb5d700"} Jul 01 22:36:53.973185 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.972307 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8wqz" event={"ID":"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4","Type":"ContainerStarted","Data":"250a94e37344e8c39165bd90687050f4141bd0beb193799aee7bb76a3591b5eb"} Jul 01 22:36:53.973185 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.972357 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8wqz" event={"ID":"9e6b90a5-73e8-4552-b7a3-d2e2b56674f4","Type":"ContainerStarted","Data":"86b7353899ca1f967f46d1626ef0c671b38bbbe584d97e826b8d580ad173d380"} Jul 01 22:36:53.975196 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.975165 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" event={"ID":"2535e99c-23db-4915-a584-63ea766e1670","Type":"ContainerStarted","Data":"2ca5de43c99415f9183519c4c52f3b3230b23dac153c24cc01829443f791bd73"} Jul 01 22:36:53.977239 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.977189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" event={"ID":"d25208c9-002d-47c1-870e-4502c24fe345","Type":"ContainerStarted","Data":"83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288"} Jul 01 22:36:53.977239 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.977233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" event={"ID":"d25208c9-002d-47c1-870e-4502c24fe345","Type":"ContainerStarted","Data":"3a00f9f18a4bf416dd4a37b1a839a3401bdede271c7c72e54aa5b47a478e7556"} Jul 01 22:36:53.977391 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.977369 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:36:53.986845 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:53.986170 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6476b4f77-f6lh9" podStartSLOduration=47.986156313 podStartE2EDuration="47.986156313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:53.985762296 +0000 UTC m=+68.549517588" watchObservedRunningTime="2026-07-01 22:36:53.986156313 +0000 UTC m=+68.549911611" Jul 01 22:36:54.025935 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:54.025884 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r8wqz" podStartSLOduration=67.950716068 podStartE2EDuration="1m9.025866485s" totalImagesPullingTime="1.075150417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:54.02478628 +0000 UTC m=+68.588541583" watchObservedRunningTime="2026-07-01 22:36:54.025866485 +0000 UTC m=+68.589621762" Jul 01 22:36:54.026113 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:54.025973 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" podStartSLOduration=68.025968736 podStartE2EDuration="1m8.025968736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:36:54.007828229 +0000 UTC m=+68.571583528" watchObservedRunningTime="2026-07-01 22:36:54.025968736 +0000 UTC m=+68.589724035" Jul 01 22:36:54.618269 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:54.618183 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:54.621424 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:54.621182 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:54.988740 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:54.988703 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" event={"ID":"b6a883c5-6aff-426a-91a5-cd0072571fab","Type":"ContainerStarted","Data":"88a86266193b4e21b92176b27bee485d7599132fc92fa5e5d722db32a5a03060"} Jul 01 22:36:54.989206 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:54.988765 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:54.989598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:54.989410 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6476b4f77-f6lh9" Jul 01 22:36:58.382237 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:58.382204 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:58.479909 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:58.479874 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:58.572387 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:58.572254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:58.786524 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:58.786489 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:58.878543 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:58.878463 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:59.380091 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:59.380051 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:59.782554 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:59.782515 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:36:59.884916 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:36:59.884894 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:00.008296 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.008267 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b85ls" event={"ID":"d81d0a19-3054-4831-967e-e3ee294084a4","Type":"ContainerStarted","Data":"170cd010c78003c7a93d00a0d28439cce38b141c9cdf898a33da551053623814"} Jul 01 22:37:00.010662 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.010627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bb8hk" event={"ID":"382757d3-0804-4b97-88c7-ecd21d46cc13","Type":"ContainerStarted","Data":"291bb597d5adfa5b84298ca102c33b6e710a9cb45466c25a482c0dc2cd0d3076"} Jul 01 22:37:00.012183 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.012156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k9f7s" event={"ID":"229c282a-5503-4f16-9dd1-48eff34a1972","Type":"ContainerStarted","Data":"57f936230fd823f3cae219c51346380be75781ebe6aca72c2d6ee01ecc76bbd9"} Jul 01 22:37:00.013650 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.013629 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" event={"ID":"2535e99c-23db-4915-a584-63ea766e1670","Type":"ContainerStarted","Data":"16935710644f1df5515d3858e921ed9d86f95a553217f91159412e1ef2f40d5f"} Jul 01 22:37:00.093254 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.093018 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bb8hk" podStartSLOduration=16.987477078 podStartE2EDuration="29.092999578s" totalImagesPullingTime="12.1055225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:36:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:00.092816639 +0000 UTC m=+74.656571936" watchObservedRunningTime="2026-07-01 22:37:00.092999578 +0000 UTC m=+74.656754879" Jul 01 22:37:00.125224 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.125175 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k9f7s" podStartSLOduration=66.29723462 podStartE2EDuration="1m14.125159343s" totalImagesPullingTime="7.827924723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:00.124495838 +0000 UTC m=+74.688251137" watchObservedRunningTime="2026-07-01 22:37:00.125159343 +0000 UTC m=+74.688914642" Jul 01 22:37:00.435011 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.434929 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:00.531713 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.531662 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:00.611687 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.611651 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r"] Jul 01 22:37:00.611858 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.611757 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:00.634055 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.634037 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r"] Jul 01 22:37:00.634139 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.634117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" Jul 01 22:37:00.636507 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.636490 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 22:37:00.636609 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.636561 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-phxjc\"" Jul 01 22:37:00.712409 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.712387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1380e2fa-2664-4fd1-9492-f66b692da3d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rr78r\" (UID: \"1380e2fa-2664-4fd1-9492-f66b692da3d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" Jul 01 22:37:00.813049 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:00.813016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1380e2fa-2664-4fd1-9492-f66b692da3d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rr78r\" (UID: \"1380e2fa-2664-4fd1-9492-f66b692da3d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" Jul 01 22:37:00.813327 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:37:00.813145 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 01 22:37:00.813327 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:37:00.813212 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1380e2fa-2664-4fd1-9492-f66b692da3d6-tls-certificates podName:1380e2fa-2664-4fd1-9492-f66b692da3d6 nodeName:}" failed. No retries permitted until 2026-07-01 22:37:01.313196719 +0000 UTC m=+75.876951995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1380e2fa-2664-4fd1-9492-f66b692da3d6-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-rr78r" (UID: "1380e2fa-2664-4fd1-9492-f66b692da3d6") : secret "prometheus-operator-admission-webhook-tls" not found Jul 01 22:37:01.018832 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.018738 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" event={"ID":"dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4","Type":"ContainerStarted","Data":"70cecdfb83f2dec76b4cca2cd53bfc0953eb38cb789bd2001a1ae9ef2fc792ed"} Jul 01 22:37:01.020471 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.020436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b85ls" event={"ID":"d81d0a19-3054-4831-967e-e3ee294084a4","Type":"ContainerStarted","Data":"bd84bf1cf5fa4d70dc1e8cb56546e3e46981b29468dad230843de169e1ee2a04"} Jul 01 22:37:01.020656 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.020638 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b85ls" Jul 01 22:37:01.022426 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.022400 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" event={"ID":"2535e99c-23db-4915-a584-63ea766e1670","Type":"ContainerStarted","Data":"35745154d8b9803a57be2bf6c26c01e5581097083fcaa5f382321d2e2c322944"} Jul 01 22:37:01.024064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.024037 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" event={"ID":"b6a883c5-6aff-426a-91a5-cd0072571fab","Type":"ContainerStarted","Data":"2c9971f01f994fe73fa682cf6e6288a779a944a6c7ef05999b744fc90f4947f6"} Jul 01 22:37:01.035980 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.035945 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vv9k4" podStartSLOduration=48.987458486 podStartE2EDuration="55.035932244s" totalImagesPullingTime="6.048473758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:01.035330029 +0000 UTC m=+75.599085329" watchObservedRunningTime="2026-07-01 22:37:01.035932244 +0000 UTC m=+75.599687565" Jul 01 22:37:01.054822 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.054768 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b85ls" podStartSLOduration=34.035031147 podStartE2EDuration="40.054757519s" totalImagesPullingTime="6.019726372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:01.053672502 +0000 UTC m=+75.617427803" watchObservedRunningTime="2026-07-01 22:37:01.054757519 +0000 UTC m=+75.618512818" Jul 01 22:37:01.070898 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.070857 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-xnfcq" podStartSLOduration=35.354436684 podStartE2EDuration="41.070843225s" totalImagesPullingTime="5.716406541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:01.069926984 +0000 UTC m=+75.633682284" watchObservedRunningTime="2026-07-01 22:37:01.070843225 +0000 UTC m=+75.634598524" Jul 01 22:37:01.087439 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.087397 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-fcjfz" podStartSLOduration=49.363394057 podStartE2EDuration="55.087384118s" totalImagesPullingTime="5.723990061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:01.086886961 +0000 UTC m=+75.650642285" watchObservedRunningTime="2026-07-01 22:37:01.087384118 +0000 UTC m=+75.651139416" Jul 01 22:37:01.208105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.208076 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:01.317823 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.317745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1380e2fa-2664-4fd1-9492-f66b692da3d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rr78r\" (UID: \"1380e2fa-2664-4fd1-9492-f66b692da3d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" Jul 01 22:37:01.320095 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.320077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1380e2fa-2664-4fd1-9492-f66b692da3d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rr78r\" (UID: \"1380e2fa-2664-4fd1-9492-f66b692da3d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" Jul 01 22:37:01.368155 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.368125 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:01.542891 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.542864 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" Jul 01 22:37:01.547731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.547707 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:01.624736 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.624662 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:01.684165 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:01.684134 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r"] Jul 01 22:37:01.686883 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:37:01.686853 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1380e2fa_2664_4fd1_9492_f66b692da3d6.slice/crio-f987d1d514ec493ec0487473ed8bf57684eae6bab9646a08584a6c621c6d17f6 WatchSource:0}: Error finding container f987d1d514ec493ec0487473ed8bf57684eae6bab9646a08584a6c621c6d17f6: Status 404 returned error can't find the container with id f987d1d514ec493ec0487473ed8bf57684eae6bab9646a08584a6c621c6d17f6 Jul 01 22:37:02.030687 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:02.030652 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" event={"ID":"1380e2fa-2664-4fd1-9492-f66b692da3d6","Type":"ContainerStarted","Data":"f987d1d514ec493ec0487473ed8bf57684eae6bab9646a08584a6c621c6d17f6"} Jul 01 22:37:03.404780 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:03.404752 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:03.468162 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:03.468138 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:04.039387 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:04.039353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" event={"ID":"1380e2fa-2664-4fd1-9492-f66b692da3d6","Type":"ContainerStarted","Data":"3965c9cafe14d582b6438b22b9e5d4e5b79db709a6cb2104d5fe63f512b9bb81"} Jul 01 22:37:04.039569 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:04.039541 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" Jul 01 22:37:04.044287 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:04.044264 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" Jul 01 22:37:04.061861 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:04.061822 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rr78r" podStartSLOduration=2.429761157 podStartE2EDuration="4.061788734s" totalImagesPullingTime="1.632027577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:04.061538905 +0000 UTC m=+78.625294205" watchObservedRunningTime="2026-07-01 22:37:04.061788734 +0000 UTC m=+78.625544034" Jul 01 22:37:04.642886 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:04.642851 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:04.716182 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:04.716152 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:04.834010 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:04.833983 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:04.866483 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:04.866462 2561 scope.go:117] "RemoveContainer" containerID="96dd4ca75b28aa97611e7b45032cbb69d69151d1ee7382fd5dd133e2ae7f4e26" Jul 01 22:37:04.866641 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:37:04.866623 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-9wckq_openshift-console-operator(28aa0edc-b179-4962-97f2-32eb340bff4e)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" podUID="28aa0edc-b179-4962-97f2-32eb340bff4e" Jul 01 22:37:04.994274 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:04.994246 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:05.063917 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:05.063882 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:06.139671 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:06.139635 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:06.247297 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:06.247263 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:11.033883 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:11.033701 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b85ls" Jul 01 22:37:11.377124 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:11.377024 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:13.418084 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:13.418047 2561 patch_prober.go:28] interesting pod/image-registry-6fbbdb466b-sb6dh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 22:37:13.418437 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:13.418107 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" podUID="d25208c9-002d-47c1-870e-4502c24fe345" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 22:37:13.796310 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:13.796281 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.006991 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.006959 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.074862 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.074780 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tcn8d"] Jul 01 22:37:14.077737 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.077718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.080205 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.080185 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 22:37:14.081131 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.081113 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 22:37:14.081216 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.081148 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 22:37:14.081350 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.081333 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bgjw6\"" Jul 01 22:37:14.083853 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.083834 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 22:37:14.126883 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.126863 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.210446 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.210416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.210572 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.210482 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8p9\" (UniqueName: \"kubernetes.io/projected/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-kube-api-access-vr8p9\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.210572 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.210517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-metrics-client-ca\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.210572 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.210547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-textfile\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.210739 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.210575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-root\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.210739 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.210598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-wtmp\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.210739 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.210640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-sys\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.210739 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.210669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.210739 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.210728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-tls\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.254494 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.254465 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.311727 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.311700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.311856 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.311730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-tls\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.311856 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.311756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.311856 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.311816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8p9\" (UniqueName: \"kubernetes.io/projected/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-kube-api-access-vr8p9\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.311856 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.311851 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-metrics-client-ca\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312062 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:37:14.311879 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 22:37:14.312062 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.311891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-textfile\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312062 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:37:14.311940 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-tls podName:94b2b55b-b7a8-4f2f-9986-51ad042f92d4 nodeName:}" failed. No retries permitted until 2026-07-01 22:37:14.811919268 +0000 UTC m=+89.375674562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-tls") pod "node-exporter-tcn8d" (UID: "94b2b55b-b7a8-4f2f-9986-51ad042f92d4") : secret "node-exporter-tls" not found Jul 01 22:37:14.312062 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.312014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-root\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.312064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-wtmp\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.312100 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-root\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.312106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-sys\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.312146 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-sys\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.312232 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-wtmp\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312491 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.312353 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-textfile\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312491 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.312473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.312575 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.312511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-metrics-client-ca\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.314066 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.314050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.326905 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.326861 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8p9\" (UniqueName: \"kubernetes.io/projected/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-kube-api-access-vr8p9\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.349473 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.349448 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.450014 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.449981 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.550121 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.550067 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.651831 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.651742 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.751427 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.751397 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.816114 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.816084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-tls\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.818427 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.818407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94b2b55b-b7a8-4f2f-9986-51ad042f92d4-node-exporter-tls\") pod \"node-exporter-tcn8d\" (UID: \"94b2b55b-b7a8-4f2f-9986-51ad042f92d4\") " pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.978275 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.978245 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:14.986578 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.986552 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tcn8d" Jul 01 22:37:14.993705 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:14.993686 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:37:14.996851 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:37:14.996829 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b2b55b_b7a8_4f2f_9986_51ad042f92d4.slice/crio-5277cd86d624680ddc91539f940f0a80e4f242d80f17a0800bd16dfa7205b8a0 WatchSource:0}: Error finding container 5277cd86d624680ddc91539f940f0a80e4f242d80f17a0800bd16dfa7205b8a0: Status 404 returned error can't find the container with id 5277cd86d624680ddc91539f940f0a80e4f242d80f17a0800bd16dfa7205b8a0 Jul 01 22:37:15.083710 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:15.083671 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tcn8d" event={"ID":"94b2b55b-b7a8-4f2f-9986-51ad042f92d4","Type":"ContainerStarted","Data":"5277cd86d624680ddc91539f940f0a80e4f242d80f17a0800bd16dfa7205b8a0"} Jul 01 22:37:15.084160 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:15.084133 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:15.300003 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:15.299908 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:15.401462 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:15.401427 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:15.536854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:15.536818 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:16.088479 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:16.088404 2561 generic.go:356] "Generic (PLEG): container finished" podID="94b2b55b-b7a8-4f2f-9986-51ad042f92d4" containerID="30b20c5a96319e153a6772fdd6cf1f4ad38e88007ce9e1461b2f254a7bf85c15" exitCode=0 Jul 01 22:37:16.088479 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:16.088448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tcn8d" event={"ID":"94b2b55b-b7a8-4f2f-9986-51ad042f92d4","Type":"ContainerDied","Data":"30b20c5a96319e153a6772fdd6cf1f4ad38e88007ce9e1461b2f254a7bf85c15"} Jul 01 22:37:16.415429 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:16.415350 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:16.516272 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:16.516230 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:16.960841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:16.960784 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:17.066764 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:17.066735 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:17.094036 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:17.094005 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tcn8d" event={"ID":"94b2b55b-b7a8-4f2f-9986-51ad042f92d4","Type":"ContainerStarted","Data":"09ad5c1cf996f73bba944225471a744c163be060546de59975573005404eae5c"} Jul 01 22:37:17.094144 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:17.094061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tcn8d" event={"ID":"94b2b55b-b7a8-4f2f-9986-51ad042f92d4","Type":"ContainerStarted","Data":"98157c46a5a7e4c00129dfc8dd62a1d91e7168b8fd722e65010634313991174e"} Jul 01 22:37:17.151989 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:17.151947 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tcn8d" podStartSLOduration=2.246498613 podStartE2EDuration="3.151932645s" totalImagesPullingTime="841.856314ms" totalInitContainerRuntime="63.577718ms" isStatefulPod=true podCreationTimestamp="2026-07-01 22:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:17.144084665 +0000 UTC m=+91.707839965" watchObservedRunningTime="2026-07-01 22:37:17.151932645 +0000 UTC m=+91.715687943" Jul 01 22:37:17.231171 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:17.231098 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:17.421630 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:17.421594 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:18.812981 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:18.812947 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:18.866523 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:18.866486 2561 scope.go:117] "RemoveContainer" containerID="96dd4ca75b28aa97611e7b45032cbb69d69151d1ee7382fd5dd133e2ae7f4e26" Jul 01 22:37:19.016242 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.016209 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:19.103522 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.103458 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/2.log" Jul 01 22:37:19.103653 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.103548 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" event={"ID":"28aa0edc-b179-4962-97f2-32eb340bff4e","Type":"ContainerStarted","Data":"dfd42b1253d7a11504864931473f3a3e1c27a93e6a08e044b4a1b6bcba8147c8"} Jul 01 22:37:19.103917 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.103893 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:37:19.147544 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.147492 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" podStartSLOduration=65.774285122 podStartE2EDuration="1m13.147477432s" totalImagesPullingTime="7.37319231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:19.147403287 +0000 UTC m=+93.711158585" watchObservedRunningTime="2026-07-01 22:37:19.147477432 +0000 UTC m=+93.711232731" Jul 01 22:37:19.309539 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.309510 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:19.333069 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.333040 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-9wckq" Jul 01 22:37:19.442191 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.442117 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:19.547160 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.547123 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:19.650168 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.650135 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:19.710988 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.710963 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:19.827311 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:19.827287 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:20.001215 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:20.001135 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:20.103537 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:20.103503 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:20.201081 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:20.201046 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:20.281525 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:20.281456 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:20.387758 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:20.387728 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:20.619452 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:20.619375 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:21.149976 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:21.149940 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:21.251042 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:21.251010 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:21.417185 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:21.417114 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:21.918361 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:21.918336 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:22.106494 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:22.106459 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fbbdb466b-sb6dh"] Jul 01 22:37:22.209342 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:22.209312 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:22.311361 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:22.311327 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:22.372923 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:22.372893 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:22.626257 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:22.626172 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:22.727392 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:22.727360 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:23.232185 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:23.232152 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:23.333403 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:23.333372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:23.980293 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:23.980267 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8hbnk" Jul 01 22:37:24.127409 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:24.127374 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:24.191909 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:24.191879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:26.143806 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:26.143772 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:26.213258 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:26.213225 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:30.189529 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.189500 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55747cd84-cp958"] Jul 01 22:37:30.399848 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.399786 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55747cd84-cp958"] Jul 01 22:37:30.400002 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.399916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.402568 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.402539 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 22:37:30.402707 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.402630 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 22:37:30.402787 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.402762 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ht85v\"" Jul 01 22:37:30.402876 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.402810 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 22:37:30.403419 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.403393 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 22:37:30.403419 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.403410 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 22:37:30.403610 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.403401 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 22:37:30.403610 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.403453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 22:37:30.436394 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.436372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-config\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.436529 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.436401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-service-ca\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.436529 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.436453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-serving-cert\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.436529 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.436501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brxlj\" (UniqueName: \"kubernetes.io/projected/a1d3f873-e0d8-413a-9eb7-c51f356e6359-kube-api-access-brxlj\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.436687 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.436544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-oauth-serving-cert\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.436687 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.436619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-oauth-config\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.537701 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.537676 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-oauth-config\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.537866 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.537709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-config\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.537866 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.537725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-service-ca\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.537866 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.537755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-serving-cert\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.537866 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.537839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brxlj\" (UniqueName: \"kubernetes.io/projected/a1d3f873-e0d8-413a-9eb7-c51f356e6359-kube-api-access-brxlj\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.538089 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.537875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-oauth-serving-cert\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.538458 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.538437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-config\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.538458 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.538452 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-service-ca\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.538608 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.538589 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-oauth-serving-cert\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.540230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.540209 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-oauth-config\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.540325 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.540237 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-serving-cert\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.548223 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.548202 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brxlj\" (UniqueName: \"kubernetes.io/projected/a1d3f873-e0d8-413a-9eb7-c51f356e6359-kube-api-access-brxlj\") pod \"console-55747cd84-cp958\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.709621 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.709585 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:30.855489 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:30.855358 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55747cd84-cp958"] Jul 01 22:37:30.858088 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:37:30.858065 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d3f873_e0d8_413a_9eb7_c51f356e6359.slice/crio-311299bf68d626a26b00abd027a8c2f8173a436a1f6a3f4acba65afbea2c42b4 WatchSource:0}: Error finding container 311299bf68d626a26b00abd027a8c2f8173a436a1f6a3f4acba65afbea2c42b4: Status 404 returned error can't find the container with id 311299bf68d626a26b00abd027a8c2f8173a436a1f6a3f4acba65afbea2c42b4 Jul 01 22:37:31.144984 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:31.144904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55747cd84-cp958" event={"ID":"a1d3f873-e0d8-413a-9eb7-c51f356e6359","Type":"ContainerStarted","Data":"311299bf68d626a26b00abd027a8c2f8173a436a1f6a3f4acba65afbea2c42b4"} Jul 01 22:37:31.412476 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:31.412399 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:31.512251 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:31.512221 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:32.329586 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:32.329503 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:32.399854 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:32.399819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:34.159345 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:34.159310 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55747cd84-cp958" event={"ID":"a1d3f873-e0d8-413a-9eb7-c51f356e6359","Type":"ContainerStarted","Data":"6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a"} Jul 01 22:37:34.177995 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:34.177949 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55747cd84-cp958" podStartSLOduration=0.946087709 podStartE2EDuration="4.177932832s" totalImagesPullingTime="3.231845123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:34.177036573 +0000 UTC m=+108.740791873" watchObservedRunningTime="2026-07-01 22:37:34.177932832 +0000 UTC m=+108.741688130" Jul 01 22:37:35.296543 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:35.296507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:35.395808 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:35.395771 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:36.168028 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:36.167995 2561 generic.go:356] "Generic (PLEG): container finished" podID="2eec3495-46ac-42d8-b407-be057f6ae1d7" containerID="d277bb00437b1090d8b1038038d054f78c00faa1319f5871f4c60d83c8504033" exitCode=0 Jul 01 22:37:36.168190 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:36.168070 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" event={"ID":"2eec3495-46ac-42d8-b407-be057f6ae1d7","Type":"ContainerDied","Data":"d277bb00437b1090d8b1038038d054f78c00faa1319f5871f4c60d83c8504033"} Jul 01 22:37:36.168393 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:36.168379 2561 scope.go:117] "RemoveContainer" containerID="d277bb00437b1090d8b1038038d054f78c00faa1319f5871f4c60d83c8504033" Jul 01 22:37:37.174096 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.174065 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-rg4dj" event={"ID":"2eec3495-46ac-42d8-b407-be057f6ae1d7","Type":"ContainerStarted","Data":"2767ac2a64ae11b268eebe8bda2ca505e47e030fa95c4ecb4c20cdbe404b3614"} Jul 01 22:37:37.186325 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.186296 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:37.287580 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.287542 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:37.624587 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.624541 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-567d9fc8df-xr4dj"] Jul 01 22:37:37.627652 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.627636 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.638818 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.638776 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 22:37:37.643342 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.643316 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567d9fc8df-xr4dj"] Jul 01 22:37:37.692621 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.692595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blmzd\" (UniqueName: \"kubernetes.io/projected/ffce69d1-9349-4b93-a858-6bdb5f40afaa-kube-api-access-blmzd\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.692744 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.692632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-service-ca\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.692744 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.692651 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-config\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.692744 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.692675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-oauth-config\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.692744 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.692715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-trusted-ca-bundle\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.692920 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.692772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-oauth-serving-cert\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.692920 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.692831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-serving-cert\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.793560 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.793534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-service-ca\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.793653 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.793563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-config\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.793653 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.793587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-oauth-config\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.793653 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.793602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-trusted-ca-bundle\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.793653 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.793644 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-oauth-serving-cert\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.793872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.793677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-serving-cert\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.793872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.793759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blmzd\" (UniqueName: \"kubernetes.io/projected/ffce69d1-9349-4b93-a858-6bdb5f40afaa-kube-api-access-blmzd\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.794383 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.794361 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-service-ca\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.794497 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.794476 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-config\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.794565 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.794507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-oauth-serving-cert\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.794565 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.794534 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-trusted-ca-bundle\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.796609 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.796591 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-oauth-config\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.796709 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.796676 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-serving-cert\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.802309 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.802289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blmzd\" (UniqueName: \"kubernetes.io/projected/ffce69d1-9349-4b93-a858-6bdb5f40afaa-kube-api-access-blmzd\") pod \"console-567d9fc8df-xr4dj\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:37.942861 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:37.942770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:38.044922 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:38.044854 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:38.074588 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:38.074560 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567d9fc8df-xr4dj"] Jul 01 22:37:38.077435 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:37:38.077408 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffce69d1_9349_4b93_a858_6bdb5f40afaa.slice/crio-d7f626dcd1e4544cbb19c384a6cfc9848755f80fb2dced5e6a073f836e09d4ab WatchSource:0}: Error finding container d7f626dcd1e4544cbb19c384a6cfc9848755f80fb2dced5e6a073f836e09d4ab: Status 404 returned error can't find the container with id d7f626dcd1e4544cbb19c384a6cfc9848755f80fb2dced5e6a073f836e09d4ab Jul 01 22:37:38.145344 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:38.145321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:38.179881 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:38.179846 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567d9fc8df-xr4dj" event={"ID":"ffce69d1-9349-4b93-a858-6bdb5f40afaa","Type":"ContainerStarted","Data":"28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376"} Jul 01 22:37:38.180208 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:38.179904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567d9fc8df-xr4dj" event={"ID":"ffce69d1-9349-4b93-a858-6bdb5f40afaa","Type":"ContainerStarted","Data":"d7f626dcd1e4544cbb19c384a6cfc9848755f80fb2dced5e6a073f836e09d4ab"} Jul 01 22:37:38.201916 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:38.201870 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-567d9fc8df-xr4dj" podStartSLOduration=1.201855814 podStartE2EDuration="1.201855814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:37:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:37:38.19961675 +0000 UTC m=+112.763372049" watchObservedRunningTime="2026-07-01 22:37:38.201855814 +0000 UTC m=+112.765611113" Jul 01 22:37:40.189506 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:40.189421 2561 generic.go:356] "Generic (PLEG): container finished" podID="7c079d5a-ede0-43d8-8ee5-c9b778d53386" containerID="786c3820d4f3f26048ef108245cf4f11aafe7de882ab17c2203e580f01f84f39" exitCode=0 Jul 01 22:37:40.189850 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:40.189499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-kntrj" event={"ID":"7c079d5a-ede0-43d8-8ee5-c9b778d53386","Type":"ContainerDied","Data":"786c3820d4f3f26048ef108245cf4f11aafe7de882ab17c2203e580f01f84f39"} Jul 01 22:37:40.189899 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:40.189855 2561 scope.go:117] "RemoveContainer" containerID="786c3820d4f3f26048ef108245cf4f11aafe7de882ab17c2203e580f01f84f39" Jul 01 22:37:40.710179 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:40.710142 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:40.710379 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:40.710208 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:40.714943 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:40.714908 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:41.195465 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:41.195385 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-kntrj" event={"ID":"7c079d5a-ede0-43d8-8ee5-c9b778d53386","Type":"ContainerStarted","Data":"2f6f4d5a88e1189b3df2ac773526398a7dc3ab0c8aeb109251e2695a98bc803b"} Jul 01 22:37:41.200190 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:41.200165 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55747cd84-cp958" Jul 01 22:37:42.368450 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:42.368414 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:42.470035 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:42.470002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:43.839645 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:43.839611 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:43.894767 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:43.894733 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:46.406541 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:46.406507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:46.503038 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:46.503008 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:47.127134 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.127099 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" podUID="d25208c9-002d-47c1-870e-4502c24fe345" containerName="registry" containerID="cri-o://83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288" gracePeriod=30 Jul 01 22:37:47.372945 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.372923 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:37:47.473781 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.473752 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-bound-sa-token\") pod \"d25208c9-002d-47c1-870e-4502c24fe345\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " Jul 01 22:37:47.474188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.473812 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-installation-pull-secrets\") pod \"d25208c9-002d-47c1-870e-4502c24fe345\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " Jul 01 22:37:47.474188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.473833 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-image-registry-private-configuration\") pod \"d25208c9-002d-47c1-870e-4502c24fe345\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " Jul 01 22:37:47.474188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.473853 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-trusted-ca\") pod \"d25208c9-002d-47c1-870e-4502c24fe345\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " Jul 01 22:37:47.474188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.473874 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") pod \"d25208c9-002d-47c1-870e-4502c24fe345\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " Jul 01 22:37:47.474188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.473892 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b4z2\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-kube-api-access-5b4z2\") pod \"d25208c9-002d-47c1-870e-4502c24fe345\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " Jul 01 22:37:47.474188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.473995 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-registry-certificates\") pod \"d25208c9-002d-47c1-870e-4502c24fe345\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " Jul 01 22:37:47.474188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.474041 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d25208c9-002d-47c1-870e-4502c24fe345-ca-trust-extracted\") pod \"d25208c9-002d-47c1-870e-4502c24fe345\" (UID: \"d25208c9-002d-47c1-870e-4502c24fe345\") " Jul 01 22:37:47.474542 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.474453 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d25208c9-002d-47c1-870e-4502c24fe345" (UID: "d25208c9-002d-47c1-870e-4502c24fe345"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:37:47.474542 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.474522 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d25208c9-002d-47c1-870e-4502c24fe345" (UID: "d25208c9-002d-47c1-870e-4502c24fe345"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:37:47.476401 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.476379 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d25208c9-002d-47c1-870e-4502c24fe345" (UID: "d25208c9-002d-47c1-870e-4502c24fe345"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:37:47.476539 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.476523 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d25208c9-002d-47c1-870e-4502c24fe345" (UID: "d25208c9-002d-47c1-870e-4502c24fe345"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:37:47.476616 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.476556 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d25208c9-002d-47c1-870e-4502c24fe345" (UID: "d25208c9-002d-47c1-870e-4502c24fe345"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:37:47.476668 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.476627 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d25208c9-002d-47c1-870e-4502c24fe345" (UID: "d25208c9-002d-47c1-870e-4502c24fe345"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:37:47.476852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.476834 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-kube-api-access-5b4z2" (OuterVolumeSpecName: "kube-api-access-5b4z2") pod "d25208c9-002d-47c1-870e-4502c24fe345" (UID: "d25208c9-002d-47c1-870e-4502c24fe345"). InnerVolumeSpecName "kube-api-access-5b4z2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:37:47.482745 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.482723 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25208c9-002d-47c1-870e-4502c24fe345-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d25208c9-002d-47c1-870e-4502c24fe345" (UID: "d25208c9-002d-47c1-870e-4502c24fe345"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:37:47.575236 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.575213 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-registry-tls\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:37:47.575236 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.575236 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b4z2\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-kube-api-access-5b4z2\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:37:47.575356 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.575248 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-registry-certificates\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:37:47.575356 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.575257 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d25208c9-002d-47c1-870e-4502c24fe345-ca-trust-extracted\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:37:47.575356 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.575265 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d25208c9-002d-47c1-870e-4502c24fe345-bound-sa-token\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:37:47.575356 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.575273 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-installation-pull-secrets\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:37:47.575356 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.575283 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d25208c9-002d-47c1-870e-4502c24fe345-image-registry-private-configuration\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:37:47.575356 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.575291 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d25208c9-002d-47c1-870e-4502c24fe345-trusted-ca\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:37:47.942970 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.942940 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:47.943100 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.942991 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:47.947444 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:47.947420 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:48.221507 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.221477 2561 generic.go:356] "Generic (PLEG): container finished" podID="d25208c9-002d-47c1-870e-4502c24fe345" containerID="83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288" exitCode=0 Jul 01 22:37:48.221656 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.221523 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" Jul 01 22:37:48.221656 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.221561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" event={"ID":"d25208c9-002d-47c1-870e-4502c24fe345","Type":"ContainerDied","Data":"83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288"} Jul 01 22:37:48.221656 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.221606 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbbdb466b-sb6dh" event={"ID":"d25208c9-002d-47c1-870e-4502c24fe345","Type":"ContainerDied","Data":"3a00f9f18a4bf416dd4a37b1a839a3401bdede271c7c72e54aa5b47a478e7556"} Jul 01 22:37:48.221656 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.221626 2561 scope.go:117] "RemoveContainer" containerID="83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288" Jul 01 22:37:48.226255 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.226240 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:37:48.230120 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.230102 2561 scope.go:117] "RemoveContainer" containerID="83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288" Jul 01 22:37:48.230369 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:37:48.230350 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288\": container with ID starting with 83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288 not found: ID does not exist" containerID="83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288" Jul 01 22:37:48.230436 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.230388 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288"} err="failed to get container status \"83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288\": rpc error: code = NotFound desc = could not find container \"83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288\": container with ID starting with 83bcc1c50fb597ad87528a8cfd2bfa5a748e8f96edaa0c9fb1848be48380f288 not found: ID does not exist" Jul 01 22:37:48.237200 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.237178 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fbbdb466b-sb6dh"] Jul 01 22:37:48.241395 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.241372 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fbbdb466b-sb6dh"] Jul 01 22:37:48.287201 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.287178 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55747cd84-cp958"] Jul 01 22:37:48.441380 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.441345 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:48.540710 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.540630 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:48.618070 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:48.618039 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:49.875406 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:49.875374 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25208c9-002d-47c1-870e-4502c24fe345" path="/var/lib/kubelet/pods/d25208c9-002d-47c1-870e-4502c24fe345/volumes" Jul 01 22:37:59.536997 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:59.536955 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:37:59.638074 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:37:59.638044 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:01.275427 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:01.275390 2561 generic.go:356] "Generic (PLEG): container finished" podID="c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab" containerID="672f54f5afdda4016ab0ac07fc9f764ee0b206e1c7ec5af781a06dfd506d2a6f" exitCode=0 Jul 01 22:38:01.275427 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:01.275430 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" event={"ID":"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab","Type":"ContainerDied","Data":"672f54f5afdda4016ab0ac07fc9f764ee0b206e1c7ec5af781a06dfd506d2a6f"} Jul 01 22:38:01.275899 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:01.275702 2561 scope.go:117] "RemoveContainer" containerID="672f54f5afdda4016ab0ac07fc9f764ee0b206e1c7ec5af781a06dfd506d2a6f" Jul 01 22:38:01.400456 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:01.400418 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:01.463696 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:01.463666 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:01.992253 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:01.992217 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:02.281230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:02.281154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-bln5k" event={"ID":"c7ce21e3-a7a6-437a-ba5f-ade33dcf1fab","Type":"ContainerStarted","Data":"5b2349ec0e97b6c64b2d657990c549bccf5d6617a12775c723af4f404bc2cea0"} Jul 01 22:38:13.308701 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.308637 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55747cd84-cp958" podUID="a1d3f873-e0d8-413a-9eb7-c51f356e6359" containerName="console" containerID="cri-o://6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a" gracePeriod=15 Jul 01 22:38:13.551577 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.551556 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55747cd84-cp958" Jul 01 22:38:13.674122 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.674041 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-oauth-serving-cert\") pod \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " Jul 01 22:38:13.674122 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.674093 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-oauth-config\") pod \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " Jul 01 22:38:13.674339 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.674122 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brxlj\" (UniqueName: \"kubernetes.io/projected/a1d3f873-e0d8-413a-9eb7-c51f356e6359-kube-api-access-brxlj\") pod \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " Jul 01 22:38:13.674339 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.674144 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-config\") pod \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " Jul 01 22:38:13.674339 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.674172 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-serving-cert\") pod \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " Jul 01 22:38:13.674339 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.674191 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-service-ca\") pod \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\" (UID: \"a1d3f873-e0d8-413a-9eb7-c51f356e6359\") " Jul 01 22:38:13.674529 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.674490 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a1d3f873-e0d8-413a-9eb7-c51f356e6359" (UID: "a1d3f873-e0d8-413a-9eb7-c51f356e6359"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:13.674633 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.674605 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-config" (OuterVolumeSpecName: "console-config") pod "a1d3f873-e0d8-413a-9eb7-c51f356e6359" (UID: "a1d3f873-e0d8-413a-9eb7-c51f356e6359"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:13.674691 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.674637 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-service-ca" (OuterVolumeSpecName: "service-ca") pod "a1d3f873-e0d8-413a-9eb7-c51f356e6359" (UID: "a1d3f873-e0d8-413a-9eb7-c51f356e6359"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:13.676397 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.676373 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d3f873-e0d8-413a-9eb7-c51f356e6359-kube-api-access-brxlj" (OuterVolumeSpecName: "kube-api-access-brxlj") pod "a1d3f873-e0d8-413a-9eb7-c51f356e6359" (UID: "a1d3f873-e0d8-413a-9eb7-c51f356e6359"). InnerVolumeSpecName "kube-api-access-brxlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:38:13.676470 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.676398 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a1d3f873-e0d8-413a-9eb7-c51f356e6359" (UID: "a1d3f873-e0d8-413a-9eb7-c51f356e6359"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:13.676516 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.676465 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a1d3f873-e0d8-413a-9eb7-c51f356e6359" (UID: "a1d3f873-e0d8-413a-9eb7-c51f356e6359"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:13.775139 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.775114 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-oauth-serving-cert\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:13.775139 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.775135 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-oauth-config\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:13.775287 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.775144 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brxlj\" (UniqueName: \"kubernetes.io/projected/a1d3f873-e0d8-413a-9eb7-c51f356e6359-kube-api-access-brxlj\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:13.775287 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.775154 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-config\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:13.775287 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.775162 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1d3f873-e0d8-413a-9eb7-c51f356e6359-console-serving-cert\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:13.775287 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.775170 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d3f873-e0d8-413a-9eb7-c51f356e6359-service-ca\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:13.985258 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:13.985226 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:14.086318 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.086289 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:14.326355 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.326274 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1d3f873-e0d8-413a-9eb7-c51f356e6359" containerID="6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a" exitCode=0 Jul 01 22:38:14.326355 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.326315 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55747cd84-cp958" Jul 01 22:38:14.326770 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.326354 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55747cd84-cp958" event={"ID":"a1d3f873-e0d8-413a-9eb7-c51f356e6359","Type":"ContainerDied","Data":"6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a"} Jul 01 22:38:14.326770 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.326408 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55747cd84-cp958" event={"ID":"a1d3f873-e0d8-413a-9eb7-c51f356e6359","Type":"ContainerDied","Data":"311299bf68d626a26b00abd027a8c2f8173a436a1f6a3f4acba65afbea2c42b4"} Jul 01 22:38:14.326770 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.326427 2561 scope.go:117] "RemoveContainer" containerID="6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a" Jul 01 22:38:14.334490 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.334473 2561 scope.go:117] "RemoveContainer" containerID="6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a" Jul 01 22:38:14.334727 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:38:14.334708 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a\": container with ID starting with 6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a not found: ID does not exist" containerID="6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a" Jul 01 22:38:14.334805 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.334736 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a"} err="failed to get container status \"6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a\": rpc error: code = NotFound desc = could not find container \"6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a\": container with ID starting with 6237526d6f0c3b59c2b55faaa08ede03967218bb4ecdcf02edd89c93df6df20a not found: ID does not exist" Jul 01 22:38:14.344616 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.343578 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55747cd84-cp958"] Jul 01 22:38:14.348314 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:14.348292 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55747cd84-cp958"] Jul 01 22:38:15.870666 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:15.870633 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1d3f873-e0d8-413a-9eb7-c51f356e6359" path="/var/lib/kubelet/pods/a1d3f873-e0d8-413a-9eb7-c51f356e6359/volumes" Jul 01 22:38:19.542214 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.542180 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fbd66cfd7-qpcv5"] Jul 01 22:38:19.542672 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.542589 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d3f873-e0d8-413a-9eb7-c51f356e6359" containerName="console" Jul 01 22:38:19.542672 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.542609 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d3f873-e0d8-413a-9eb7-c51f356e6359" containerName="console" Jul 01 22:38:19.542672 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.542633 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25208c9-002d-47c1-870e-4502c24fe345" containerName="registry" Jul 01 22:38:19.542672 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.542641 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25208c9-002d-47c1-870e-4502c24fe345" containerName="registry" Jul 01 22:38:19.542891 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.542706 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d3f873-e0d8-413a-9eb7-c51f356e6359" containerName="console" Jul 01 22:38:19.542891 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.542718 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25208c9-002d-47c1-870e-4502c24fe345" containerName="registry" Jul 01 22:38:19.546986 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.546963 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.567471 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.567444 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbd66cfd7-qpcv5"] Jul 01 22:38:19.647269 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.647221 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:19.713748 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.713720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxnpv\" (UniqueName: \"kubernetes.io/projected/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-kube-api-access-pxnpv\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.713892 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.713754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-config\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.713892 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.713773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-serving-cert\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.713892 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.713787 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-oauth-serving-cert\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.713892 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.713843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-oauth-config\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.713892 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.713886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-service-ca\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.714105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.713976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-trusted-ca-bundle\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.749404 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.749368 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:19.814598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.814540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-serving-cert\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.814598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.814565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-oauth-serving-cert\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.814598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.814580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-oauth-config\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.814835 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.814604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-service-ca\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.814835 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.814634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-trusted-ca-bundle\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.814835 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.814662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxnpv\" (UniqueName: \"kubernetes.io/projected/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-kube-api-access-pxnpv\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.814835 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.814684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-config\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.815460 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.815437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-service-ca\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.815570 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.815549 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-config\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.815612 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.815549 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-oauth-serving-cert\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.815688 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.815666 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-trusted-ca-bundle\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.817104 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.817080 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-oauth-config\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.817191 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.817168 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-serving-cert\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.822985 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.822966 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxnpv\" (UniqueName: \"kubernetes.io/projected/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-kube-api-access-pxnpv\") pod \"console-6fbd66cfd7-qpcv5\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.855947 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.855926 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:19.985492 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:19.985333 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbd66cfd7-qpcv5"] Jul 01 22:38:19.987967 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:38:19.987923 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a4a277_dab1_4b4c_b5e4_6327aefdc76f.slice/crio-514e4ab74db55a33b2c3f509838ae1fc194eaa15a5bd993459b76170d5c903d5 WatchSource:0}: Error finding container 514e4ab74db55a33b2c3f509838ae1fc194eaa15a5bd993459b76170d5c903d5: Status 404 returned error can't find the container with id 514e4ab74db55a33b2c3f509838ae1fc194eaa15a5bd993459b76170d5c903d5 Jul 01 22:38:20.350009 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:20.349972 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbd66cfd7-qpcv5" event={"ID":"77a4a277-dab1-4b4c-b5e4-6327aefdc76f","Type":"ContainerStarted","Data":"4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03"} Jul 01 22:38:20.350173 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:20.350024 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbd66cfd7-qpcv5" event={"ID":"77a4a277-dab1-4b4c-b5e4-6327aefdc76f","Type":"ContainerStarted","Data":"514e4ab74db55a33b2c3f509838ae1fc194eaa15a5bd993459b76170d5c903d5"} Jul 01 22:38:20.370745 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:20.370697 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fbd66cfd7-qpcv5" podStartSLOduration=1.370681632 podStartE2EDuration="1.370681632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:38:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:38:20.368918958 +0000 UTC m=+154.932674256" watchObservedRunningTime="2026-07-01 22:38:20.370681632 +0000 UTC m=+154.934436931" Jul 01 22:38:29.856289 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:29.856254 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:29.856720 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:29.856328 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:29.860929 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:29.860908 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:30.395852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:30.395425 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:38:30.500860 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:30.500831 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567d9fc8df-xr4dj"] Jul 01 22:38:30.687389 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:30.687297 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:30.788352 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:30.788316 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:30.842810 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:30.842774 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:31.407759 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:31.407693 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:31.509319 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:31.509279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:31.577666 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:31.577640 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:53.419481 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:53.419450 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:53.513828 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:53.513783 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:38:54.099875 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.099844 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84"] Jul 01 22:38:54.106870 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.106846 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.109497 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.109478 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xsk2h\"" Jul 01 22:38:54.109590 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.109575 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 22:38:54.110237 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.110222 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 22:38:54.113846 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.113828 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84"] Jul 01 22:38:54.177032 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.177000 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5nr9\" (UniqueName: \"kubernetes.io/projected/9b40504f-cf4b-4ffa-810f-050621201003-kube-api-access-g5nr9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.177169 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.177070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.177169 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.177137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.277486 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.277445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.277620 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.277507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5nr9\" (UniqueName: \"kubernetes.io/projected/9b40504f-cf4b-4ffa-810f-050621201003-kube-api-access-g5nr9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.277620 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.277578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.277945 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.277924 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.277945 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.277940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.286144 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.286119 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5nr9\" (UniqueName: \"kubernetes.io/projected/9b40504f-cf4b-4ffa-810f-050621201003-kube-api-access-g5nr9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.416077 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.415992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:38:54.561667 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:54.561629 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84"] Jul 01 22:38:54.565678 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:38:54.565633 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b40504f_cf4b_4ffa_810f_050621201003.slice/crio-cec0dee8faedf923be4a1058c58a781c4191efb4bfa7d9dc3f7a4f104eb414af WatchSource:0}: Error finding container cec0dee8faedf923be4a1058c58a781c4191efb4bfa7d9dc3f7a4f104eb414af: Status 404 returned error can't find the container with id cec0dee8faedf923be4a1058c58a781c4191efb4bfa7d9dc3f7a4f104eb414af Jul 01 22:38:55.486434 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.486391 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" event={"ID":"9b40504f-cf4b-4ffa-810f-050621201003","Type":"ContainerStarted","Data":"cec0dee8faedf923be4a1058c58a781c4191efb4bfa7d9dc3f7a4f104eb414af"} Jul 01 22:38:55.520457 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.520393 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-567d9fc8df-xr4dj" podUID="ffce69d1-9349-4b93-a858-6bdb5f40afaa" containerName="console" containerID="cri-o://28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376" gracePeriod=15 Jul 01 22:38:55.784434 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.784411 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:38:55.891221 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.891190 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-oauth-config\") pod \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " Jul 01 22:38:55.891390 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.891248 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-config\") pod \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " Jul 01 22:38:55.891390 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.891279 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-trusted-ca-bundle\") pod \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " Jul 01 22:38:55.891390 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.891310 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-serving-cert\") pod \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " Jul 01 22:38:55.891390 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.891366 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-oauth-serving-cert\") pod \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " Jul 01 22:38:55.891604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.891415 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blmzd\" (UniqueName: \"kubernetes.io/projected/ffce69d1-9349-4b93-a858-6bdb5f40afaa-kube-api-access-blmzd\") pod \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " Jul 01 22:38:55.891604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.891451 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-service-ca\") pod \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\" (UID: \"ffce69d1-9349-4b93-a858-6bdb5f40afaa\") " Jul 01 22:38:55.891701 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.891679 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-config" (OuterVolumeSpecName: "console-config") pod "ffce69d1-9349-4b93-a858-6bdb5f40afaa" (UID: "ffce69d1-9349-4b93-a858-6bdb5f40afaa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:55.891755 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.891697 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ffce69d1-9349-4b93-a858-6bdb5f40afaa" (UID: "ffce69d1-9349-4b93-a858-6bdb5f40afaa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:55.892090 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.892063 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-service-ca" (OuterVolumeSpecName: "service-ca") pod "ffce69d1-9349-4b93-a858-6bdb5f40afaa" (UID: "ffce69d1-9349-4b93-a858-6bdb5f40afaa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:55.892191 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.892135 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ffce69d1-9349-4b93-a858-6bdb5f40afaa" (UID: "ffce69d1-9349-4b93-a858-6bdb5f40afaa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:38:55.893856 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.893784 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ffce69d1-9349-4b93-a858-6bdb5f40afaa" (UID: "ffce69d1-9349-4b93-a858-6bdb5f40afaa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:55.893964 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.893874 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ffce69d1-9349-4b93-a858-6bdb5f40afaa" (UID: "ffce69d1-9349-4b93-a858-6bdb5f40afaa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:38:55.894355 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.894329 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffce69d1-9349-4b93-a858-6bdb5f40afaa-kube-api-access-blmzd" (OuterVolumeSpecName: "kube-api-access-blmzd") pod "ffce69d1-9349-4b93-a858-6bdb5f40afaa" (UID: "ffce69d1-9349-4b93-a858-6bdb5f40afaa"). InnerVolumeSpecName "kube-api-access-blmzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:38:55.992183 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.992147 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-oauth-config\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:55.992183 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.992178 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-config\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:55.992183 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.992188 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-trusted-ca-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:55.992352 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.992196 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffce69d1-9349-4b93-a858-6bdb5f40afaa-console-serving-cert\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:55.992352 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.992207 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-oauth-serving-cert\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:55.992352 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.992215 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blmzd\" (UniqueName: \"kubernetes.io/projected/ffce69d1-9349-4b93-a858-6bdb5f40afaa-kube-api-access-blmzd\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:55.992352 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:55.992223 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffce69d1-9349-4b93-a858-6bdb5f40afaa-service-ca\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:38:56.491872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:56.491836 2561 generic.go:356] "Generic (PLEG): container finished" podID="ffce69d1-9349-4b93-a858-6bdb5f40afaa" containerID="28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376" exitCode=0 Jul 01 22:38:56.492023 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:56.491887 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567d9fc8df-xr4dj" Jul 01 22:38:56.492023 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:56.491887 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567d9fc8df-xr4dj" event={"ID":"ffce69d1-9349-4b93-a858-6bdb5f40afaa","Type":"ContainerDied","Data":"28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376"} Jul 01 22:38:56.492125 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:56.492018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567d9fc8df-xr4dj" event={"ID":"ffce69d1-9349-4b93-a858-6bdb5f40afaa","Type":"ContainerDied","Data":"d7f626dcd1e4544cbb19c384a6cfc9848755f80fb2dced5e6a073f836e09d4ab"} Jul 01 22:38:56.492125 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:56.492047 2561 scope.go:117] "RemoveContainer" containerID="28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376" Jul 01 22:38:56.501085 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:56.501070 2561 scope.go:117] "RemoveContainer" containerID="28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376" Jul 01 22:38:56.501339 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:38:56.501320 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376\": container with ID starting with 28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376 not found: ID does not exist" containerID="28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376" Jul 01 22:38:56.501393 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:56.501352 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376"} err="failed to get container status \"28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376\": rpc error: code = NotFound desc = could not find container \"28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376\": container with ID starting with 28db536c2c7910fecfbadbe8c07f3111e3790521704dfb6b372b1ea16381b376 not found: ID does not exist" Jul 01 22:38:56.513011 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:56.512981 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567d9fc8df-xr4dj"] Jul 01 22:38:56.516152 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:56.516130 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567d9fc8df-xr4dj"] Jul 01 22:38:57.871264 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:38:57.871230 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffce69d1-9349-4b93-a858-6bdb5f40afaa" path="/var/lib/kubelet/pods/ffce69d1-9349-4b93-a858-6bdb5f40afaa/volumes" Jul 01 22:39:01.513405 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:01.513370 2561 generic.go:356] "Generic (PLEG): container finished" podID="9b40504f-cf4b-4ffa-810f-050621201003" containerID="b5fb533589568510a2e9b9069cf9515564146cd52abc731aa57979519512347c" exitCode=0 Jul 01 22:39:01.513827 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:01.513428 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" event={"ID":"9b40504f-cf4b-4ffa-810f-050621201003","Type":"ContainerDied","Data":"b5fb533589568510a2e9b9069cf9515564146cd52abc731aa57979519512347c"} Jul 01 22:39:01.553773 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:01.553744 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:01.646630 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:01.646603 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:04.528112 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:04.528076 2561 generic.go:356] "Generic (PLEG): container finished" podID="9b40504f-cf4b-4ffa-810f-050621201003" containerID="090f3921e49aae337f8f34d196c4f4b29e08f614d41ac0670d45320602c6f4e2" exitCode=0 Jul 01 22:39:04.528542 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:04.528156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" event={"ID":"9b40504f-cf4b-4ffa-810f-050621201003","Type":"ContainerDied","Data":"090f3921e49aae337f8f34d196c4f4b29e08f614d41ac0670d45320602c6f4e2"} Jul 01 22:39:11.021446 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:11.021398 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:11.099759 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:11.099718 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:11.557731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:11.557648 2561 generic.go:356] "Generic (PLEG): container finished" podID="9b40504f-cf4b-4ffa-810f-050621201003" containerID="81d59e468712f19e80241e7edef0cf62312472bde870c7065e413960b951b727" exitCode=0 Jul 01 22:39:11.557731 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:11.557711 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" event={"ID":"9b40504f-cf4b-4ffa-810f-050621201003","Type":"ContainerDied","Data":"81d59e468712f19e80241e7edef0cf62312472bde870c7065e413960b951b727"} Jul 01 22:39:12.688662 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.688638 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:39:12.830963 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.830880 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-bundle\") pod \"9b40504f-cf4b-4ffa-810f-050621201003\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " Jul 01 22:39:12.830963 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.830927 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-util\") pod \"9b40504f-cf4b-4ffa-810f-050621201003\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " Jul 01 22:39:12.831187 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.830981 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5nr9\" (UniqueName: \"kubernetes.io/projected/9b40504f-cf4b-4ffa-810f-050621201003-kube-api-access-g5nr9\") pod \"9b40504f-cf4b-4ffa-810f-050621201003\" (UID: \"9b40504f-cf4b-4ffa-810f-050621201003\") " Jul 01 22:39:12.831519 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.831494 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-bundle" (OuterVolumeSpecName: "bundle") pod "9b40504f-cf4b-4ffa-810f-050621201003" (UID: "9b40504f-cf4b-4ffa-810f-050621201003"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:39:12.833208 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.833185 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b40504f-cf4b-4ffa-810f-050621201003-kube-api-access-g5nr9" (OuterVolumeSpecName: "kube-api-access-g5nr9") pod "9b40504f-cf4b-4ffa-810f-050621201003" (UID: "9b40504f-cf4b-4ffa-810f-050621201003"). InnerVolumeSpecName "kube-api-access-g5nr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:39:12.835404 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.835380 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-util" (OuterVolumeSpecName: "util") pod "9b40504f-cf4b-4ffa-810f-050621201003" (UID: "9b40504f-cf4b-4ffa-810f-050621201003"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:39:12.932386 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.932360 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-util\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:39:12.932386 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.932382 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5nr9\" (UniqueName: \"kubernetes.io/projected/9b40504f-cf4b-4ffa-810f-050621201003-kube-api-access-g5nr9\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:39:12.932531 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:12.932395 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b40504f-cf4b-4ffa-810f-050621201003-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:39:13.566600 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:13.566564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" event={"ID":"9b40504f-cf4b-4ffa-810f-050621201003","Type":"ContainerDied","Data":"cec0dee8faedf923be4a1058c58a781c4191efb4bfa7d9dc3f7a4f104eb414af"} Jul 01 22:39:13.566600 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:13.566601 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drlb84" Jul 01 22:39:13.566816 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:13.566619 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cec0dee8faedf923be4a1058c58a781c4191efb4bfa7d9dc3f7a4f104eb414af" Jul 01 22:39:15.149309 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:15.149278 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:15.994964 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:15.994923 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.224266 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d"] Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.224857 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffce69d1-9349-4b93-a858-6bdb5f40afaa" containerName="console" Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.224876 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffce69d1-9349-4b93-a858-6bdb5f40afaa" containerName="console" Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.224889 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b40504f-cf4b-4ffa-810f-050621201003" containerName="extract" Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.224898 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b40504f-cf4b-4ffa-810f-050621201003" containerName="extract" Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.224924 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b40504f-cf4b-4ffa-810f-050621201003" containerName="pull" Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.224932 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b40504f-cf4b-4ffa-810f-050621201003" containerName="pull" Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.224965 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b40504f-cf4b-4ffa-810f-050621201003" containerName="util" Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.224972 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b40504f-cf4b-4ffa-810f-050621201003" containerName="util" Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.225096 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b40504f-cf4b-4ffa-810f-050621201003" containerName="extract" Jul 01 22:39:17.226432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.225109 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffce69d1-9349-4b93-a858-6bdb5f40afaa" containerName="console" Jul 01 22:39:17.230569 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.230549 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" Jul 01 22:39:17.233616 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.233589 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 01 22:39:17.233724 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.233632 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:39:17.233724 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.233640 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xnzjq\"" Jul 01 22:39:17.249632 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.249608 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d"] Jul 01 22:39:17.362331 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.362298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32841fcf-1ca4-4b4b-a059-11553fdeed03-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-qwd6d\" (UID: \"32841fcf-1ca4-4b4b-a059-11553fdeed03\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" Jul 01 22:39:17.362490 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.362348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6shj\" (UniqueName: \"kubernetes.io/projected/32841fcf-1ca4-4b4b-a059-11553fdeed03-kube-api-access-d6shj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-qwd6d\" (UID: \"32841fcf-1ca4-4b4b-a059-11553fdeed03\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" Jul 01 22:39:17.463583 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.463556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32841fcf-1ca4-4b4b-a059-11553fdeed03-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-qwd6d\" (UID: \"32841fcf-1ca4-4b4b-a059-11553fdeed03\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" Jul 01 22:39:17.463706 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.463600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6shj\" (UniqueName: \"kubernetes.io/projected/32841fcf-1ca4-4b4b-a059-11553fdeed03-kube-api-access-d6shj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-qwd6d\" (UID: \"32841fcf-1ca4-4b4b-a059-11553fdeed03\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" Jul 01 22:39:17.463977 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.463958 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32841fcf-1ca4-4b4b-a059-11553fdeed03-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-qwd6d\" (UID: \"32841fcf-1ca4-4b4b-a059-11553fdeed03\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" Jul 01 22:39:17.472195 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.472175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6shj\" (UniqueName: \"kubernetes.io/projected/32841fcf-1ca4-4b4b-a059-11553fdeed03-kube-api-access-d6shj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-qwd6d\" (UID: \"32841fcf-1ca4-4b4b-a059-11553fdeed03\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" Jul 01 22:39:17.540563 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.540517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" Jul 01 22:39:17.704230 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:17.704207 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d"] Jul 01 22:39:17.706989 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:39:17.706961 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32841fcf_1ca4_4b4b_a059_11553fdeed03.slice/crio-9c5935173a189bf1b34943f51a119c02594a428130ba5f1b9c788e894ca87571 WatchSource:0}: Error finding container 9c5935173a189bf1b34943f51a119c02594a428130ba5f1b9c788e894ca87571: Status 404 returned error can't find the container with id 9c5935173a189bf1b34943f51a119c02594a428130ba5f1b9c788e894ca87571 Jul 01 22:39:18.586598 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:18.586560 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" event={"ID":"32841fcf-1ca4-4b4b-a059-11553fdeed03","Type":"ContainerStarted","Data":"9c5935173a189bf1b34943f51a119c02594a428130ba5f1b9c788e894ca87571"} Jul 01 22:39:18.779247 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:18.779215 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:18.879651 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:18.879581 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:20.596452 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:20.596372 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" event={"ID":"32841fcf-1ca4-4b4b-a059-11553fdeed03","Type":"ContainerStarted","Data":"825aa8accd244747472fb689799a6bca6b4ddf81913c9b01c43b2abd6326a9c3"} Jul 01 22:39:20.622085 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:20.622008 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-qwd6d" podStartSLOduration=1.003371067 podStartE2EDuration="3.6219932s" totalImagesPullingTime="2.618622133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:39:20.620746481 +0000 UTC m=+215.184501781" watchObservedRunningTime="2026-07-01 22:39:20.6219932 +0000 UTC m=+215.185748500" Jul 01 22:39:21.027086 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.027051 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:21.168528 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.168460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:21.213915 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.213885 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk"] Jul 01 22:39:21.233828 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.233782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.236152 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.236128 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xsk2h\"" Jul 01 22:39:21.236391 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.236371 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk"] Jul 01 22:39:21.236504 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.236488 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 22:39:21.236967 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.236947 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 22:39:21.328085 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.327994 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:21.395057 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.395025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.395195 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.395093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.395195 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.395120 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9xm\" (UniqueName: \"kubernetes.io/projected/1007683c-3f02-4c59-94cd-6a89dd989a0e-kube-api-access-4q9xm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.485141 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.485111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:21.496251 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.496228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.496347 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.496261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9xm\" (UniqueName: \"kubernetes.io/projected/1007683c-3f02-4c59-94cd-6a89dd989a0e-kube-api-access-4q9xm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.496400 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.496382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.496604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.496578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.496739 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.496715 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.511288 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.511258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9xm\" (UniqueName: \"kubernetes.io/projected/1007683c-3f02-4c59-94cd-6a89dd989a0e-kube-api-access-4q9xm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.544775 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.544755 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:21.694869 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:21.694786 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk"] Jul 01 22:39:21.697474 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:39:21.697447 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1007683c_3f02_4c59_94cd_6a89dd989a0e.slice/crio-a0c0412ba8704bb0f5961f20cb3835e165feb20f217ee5d5a16a8050c359c835 WatchSource:0}: Error finding container a0c0412ba8704bb0f5961f20cb3835e165feb20f217ee5d5a16a8050c359c835: Status 404 returned error can't find the container with id a0c0412ba8704bb0f5961f20cb3835e165feb20f217ee5d5a16a8050c359c835 Jul 01 22:39:22.606940 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:22.606900 2561 generic.go:356] "Generic (PLEG): container finished" podID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerID="10b4dde53b4913173916ce563b62eeaff322831e47eb6c43b7c4a31cec9cacd3" exitCode=0 Jul 01 22:39:22.607123 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:22.606982 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" event={"ID":"1007683c-3f02-4c59-94cd-6a89dd989a0e","Type":"ContainerDied","Data":"10b4dde53b4913173916ce563b62eeaff322831e47eb6c43b7c4a31cec9cacd3"} Jul 01 22:39:22.607123 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:22.607032 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" event={"ID":"1007683c-3f02-4c59-94cd-6a89dd989a0e","Type":"ContainerStarted","Data":"a0c0412ba8704bb0f5961f20cb3835e165feb20f217ee5d5a16a8050c359c835"} Jul 01 22:39:23.022242 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.022205 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr"] Jul 01 22:39:23.044371 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.044347 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr"] Jul 01 22:39:23.044533 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.044431 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:23.047081 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.047054 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 22:39:23.047081 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.047068 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hg9v4\"" Jul 01 22:39:23.047267 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.047127 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 22:39:23.210549 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.210516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1b72957-a2f5-400c-a21a-80fd30d0890c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mhwrr\" (UID: \"f1b72957-a2f5-400c-a21a-80fd30d0890c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:23.210670 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.210602 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b8kt\" (UniqueName: \"kubernetes.io/projected/f1b72957-a2f5-400c-a21a-80fd30d0890c-kube-api-access-7b8kt\") pod \"cert-manager-webhook-7dc76cbb94-mhwrr\" (UID: \"f1b72957-a2f5-400c-a21a-80fd30d0890c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:23.311363 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.311287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b8kt\" (UniqueName: \"kubernetes.io/projected/f1b72957-a2f5-400c-a21a-80fd30d0890c-kube-api-access-7b8kt\") pod \"cert-manager-webhook-7dc76cbb94-mhwrr\" (UID: \"f1b72957-a2f5-400c-a21a-80fd30d0890c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:23.311501 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.311359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1b72957-a2f5-400c-a21a-80fd30d0890c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mhwrr\" (UID: \"f1b72957-a2f5-400c-a21a-80fd30d0890c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:23.319135 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.319114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1b72957-a2f5-400c-a21a-80fd30d0890c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mhwrr\" (UID: \"f1b72957-a2f5-400c-a21a-80fd30d0890c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:23.319274 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.319257 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b8kt\" (UniqueName: \"kubernetes.io/projected/f1b72957-a2f5-400c-a21a-80fd30d0890c-kube-api-access-7b8kt\") pod \"cert-manager-webhook-7dc76cbb94-mhwrr\" (UID: \"f1b72957-a2f5-400c-a21a-80fd30d0890c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:23.361785 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.361758 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:23.508522 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.508491 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr"] Jul 01 22:39:23.511752 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:39:23.511726 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1b72957_a2f5_400c_a21a_80fd30d0890c.slice/crio-8e2c7793adcc61fd073931624fc713b52f23a976eaf77f8fc21530729459e3c4 WatchSource:0}: Error finding container 8e2c7793adcc61fd073931624fc713b52f23a976eaf77f8fc21530729459e3c4: Status 404 returned error can't find the container with id 8e2c7793adcc61fd073931624fc713b52f23a976eaf77f8fc21530729459e3c4 Jul 01 22:39:23.612691 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:23.612635 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" event={"ID":"f1b72957-a2f5-400c-a21a-80fd30d0890c","Type":"ContainerStarted","Data":"8e2c7793adcc61fd073931624fc713b52f23a976eaf77f8fc21530729459e3c4"} Jul 01 22:39:24.707100 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:24.707062 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:24.885700 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:24.885646 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:25.567529 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:25.567449 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:25.624490 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:25.624455 2561 generic.go:356] "Generic (PLEG): container finished" podID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerID="13f2c3045f513114e2fc7fb856391e5c572ab1479b611a32ff009713fcc4cb73" exitCode=0 Jul 01 22:39:25.624688 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:25.624497 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" event={"ID":"1007683c-3f02-4c59-94cd-6a89dd989a0e","Type":"ContainerDied","Data":"13f2c3045f513114e2fc7fb856391e5c572ab1479b611a32ff009713fcc4cb73"} Jul 01 22:39:25.648138 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:25.648107 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:26.632279 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:26.632238 2561 generic.go:356] "Generic (PLEG): container finished" podID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerID="73ad01cf6e201f62dfb22ff36bc9703e8581d025dfcb41833782fb9ef53ec45f" exitCode=0 Jul 01 22:39:26.632725 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:26.632329 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" event={"ID":"1007683c-3f02-4c59-94cd-6a89dd989a0e","Type":"ContainerDied","Data":"73ad01cf6e201f62dfb22ff36bc9703e8581d025dfcb41833782fb9ef53ec45f"} Jul 01 22:39:27.639406 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.639369 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" event={"ID":"f1b72957-a2f5-400c-a21a-80fd30d0890c","Type":"ContainerStarted","Data":"569fdea4a6bdc8c69b8b57ad814da9b13178e6a909149f7e6c84bbf507b2cb82"} Jul 01 22:39:27.639787 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.639666 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:27.665742 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.665695 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" podStartSLOduration=1.081236552 podStartE2EDuration="4.665681332s" totalImagesPullingTime="3.58444478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:39:27.664122535 +0000 UTC m=+222.227877857" watchObservedRunningTime="2026-07-01 22:39:27.665681332 +0000 UTC m=+222.229436630" Jul 01 22:39:27.761872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.761850 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:27.847835 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.847808 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q9xm\" (UniqueName: \"kubernetes.io/projected/1007683c-3f02-4c59-94cd-6a89dd989a0e-kube-api-access-4q9xm\") pod \"1007683c-3f02-4c59-94cd-6a89dd989a0e\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " Jul 01 22:39:27.847967 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.847901 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-bundle\") pod \"1007683c-3f02-4c59-94cd-6a89dd989a0e\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " Jul 01 22:39:27.847967 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.847944 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-util\") pod \"1007683c-3f02-4c59-94cd-6a89dd989a0e\" (UID: \"1007683c-3f02-4c59-94cd-6a89dd989a0e\") " Jul 01 22:39:27.848284 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.848261 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-bundle" (OuterVolumeSpecName: "bundle") pod "1007683c-3f02-4c59-94cd-6a89dd989a0e" (UID: "1007683c-3f02-4c59-94cd-6a89dd989a0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:39:27.849819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.849780 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1007683c-3f02-4c59-94cd-6a89dd989a0e-kube-api-access-4q9xm" (OuterVolumeSpecName: "kube-api-access-4q9xm") pod "1007683c-3f02-4c59-94cd-6a89dd989a0e" (UID: "1007683c-3f02-4c59-94cd-6a89dd989a0e"). InnerVolumeSpecName "kube-api-access-4q9xm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:39:27.852405 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.852385 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-util" (OuterVolumeSpecName: "util") pod "1007683c-3f02-4c59-94cd-6a89dd989a0e" (UID: "1007683c-3f02-4c59-94cd-6a89dd989a0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:39:27.948454 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.948399 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-util\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:39:27.948454 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.948421 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q9xm\" (UniqueName: \"kubernetes.io/projected/1007683c-3f02-4c59-94cd-6a89dd989a0e-kube-api-access-4q9xm\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:39:27.948454 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:27.948433 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1007683c-3f02-4c59-94cd-6a89dd989a0e-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:39:28.645431 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:28.645398 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" Jul 01 22:39:28.645431 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:28.645420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhz7pk" event={"ID":"1007683c-3f02-4c59-94cd-6a89dd989a0e","Type":"ContainerDied","Data":"a0c0412ba8704bb0f5961f20cb3835e165feb20f217ee5d5a16a8050c359c835"} Jul 01 22:39:28.645891 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:28.645466 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0c0412ba8704bb0f5961f20cb3835e165feb20f217ee5d5a16a8050c359c835" Jul 01 22:39:30.945727 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:30.945691 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:31.049914 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:31.049878 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:31.900072 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:31.900025 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:33.648544 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:33.648517 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mhwrr" Jul 01 22:39:33.764788 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:33.764740 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:33.886738 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:33.886677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:34.044421 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.044394 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-5ql9s"] Jul 01 22:39:34.044706 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.044693 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerName="util" Jul 01 22:39:34.044759 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.044707 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerName="util" Jul 01 22:39:34.044759 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.044719 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerName="extract" Jul 01 22:39:34.044759 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.044725 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerName="extract" Jul 01 22:39:34.044759 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.044735 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerName="pull" Jul 01 22:39:34.044759 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.044741 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerName="pull" Jul 01 22:39:34.044952 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.044807 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1007683c-3f02-4c59-94cd-6a89dd989a0e" containerName="extract" Jul 01 22:39:34.047516 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.047501 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5ql9s" Jul 01 22:39:34.051824 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.051807 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7848s\"" Jul 01 22:39:34.058703 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.058681 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5ql9s"] Jul 01 22:39:34.194956 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.194929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggp2j\" (UniqueName: \"kubernetes.io/projected/d4871601-e5c7-4df6-8b4d-8e38e8d04ce1-kube-api-access-ggp2j\") pod \"cert-manager-59c77684cc-5ql9s\" (UID: \"d4871601-e5c7-4df6-8b4d-8e38e8d04ce1\") " pod="cert-manager/cert-manager-59c77684cc-5ql9s" Jul 01 22:39:34.195101 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.194999 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4871601-e5c7-4df6-8b4d-8e38e8d04ce1-bound-sa-token\") pod \"cert-manager-59c77684cc-5ql9s\" (UID: \"d4871601-e5c7-4df6-8b4d-8e38e8d04ce1\") " pod="cert-manager/cert-manager-59c77684cc-5ql9s" Jul 01 22:39:34.295446 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.295378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4871601-e5c7-4df6-8b4d-8e38e8d04ce1-bound-sa-token\") pod \"cert-manager-59c77684cc-5ql9s\" (UID: \"d4871601-e5c7-4df6-8b4d-8e38e8d04ce1\") " pod="cert-manager/cert-manager-59c77684cc-5ql9s" Jul 01 22:39:34.295446 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.295425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggp2j\" (UniqueName: \"kubernetes.io/projected/d4871601-e5c7-4df6-8b4d-8e38e8d04ce1-kube-api-access-ggp2j\") pod \"cert-manager-59c77684cc-5ql9s\" (UID: \"d4871601-e5c7-4df6-8b4d-8e38e8d04ce1\") " pod="cert-manager/cert-manager-59c77684cc-5ql9s" Jul 01 22:39:34.303428 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.303404 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4871601-e5c7-4df6-8b4d-8e38e8d04ce1-bound-sa-token\") pod \"cert-manager-59c77684cc-5ql9s\" (UID: \"d4871601-e5c7-4df6-8b4d-8e38e8d04ce1\") " pod="cert-manager/cert-manager-59c77684cc-5ql9s" Jul 01 22:39:34.303833 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.303819 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggp2j\" (UniqueName: \"kubernetes.io/projected/d4871601-e5c7-4df6-8b4d-8e38e8d04ce1-kube-api-access-ggp2j\") pod \"cert-manager-59c77684cc-5ql9s\" (UID: \"d4871601-e5c7-4df6-8b4d-8e38e8d04ce1\") " pod="cert-manager/cert-manager-59c77684cc-5ql9s" Jul 01 22:39:34.356693 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.356669 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5ql9s" Jul 01 22:39:34.481543 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.481513 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5ql9s"] Jul 01 22:39:34.483894 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:39:34.483863 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4871601_e5c7_4df6_8b4d_8e38e8d04ce1.slice/crio-ae0f35856fe50ea6f191f1b84b2d5d7ec29713c3c546461d0ea879f7b79831da WatchSource:0}: Error finding container ae0f35856fe50ea6f191f1b84b2d5d7ec29713c3c546461d0ea879f7b79831da: Status 404 returned error can't find the container with id ae0f35856fe50ea6f191f1b84b2d5d7ec29713c3c546461d0ea879f7b79831da Jul 01 22:39:34.671045 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.670967 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5ql9s" event={"ID":"d4871601-e5c7-4df6-8b4d-8e38e8d04ce1","Type":"ContainerStarted","Data":"d6a00652549e58a07879edc85dfdac5a99f54c8f301383747aa39c51c1278ab2"} Jul 01 22:39:34.671045 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.671012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5ql9s" event={"ID":"d4871601-e5c7-4df6-8b4d-8e38e8d04ce1","Type":"ContainerStarted","Data":"ae0f35856fe50ea6f191f1b84b2d5d7ec29713c3c546461d0ea879f7b79831da"} Jul 01 22:39:34.689650 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.689567 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-5ql9s" podStartSLOduration=0.689549008 podStartE2EDuration="689.549008ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:39:34.689231254 +0000 UTC m=+229.252986553" watchObservedRunningTime="2026-07-01 22:39:34.689549008 +0000 UTC m=+229.253304307" Jul 01 22:39:34.809428 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:34.809395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:39.513175 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:39.513124 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:39.614193 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:39.614158 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:41.243426 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.243397 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:41.468379 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.468347 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld"] Jul 01 22:39:41.471461 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.471443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.473779 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.473758 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 22:39:41.474524 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.474501 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 22:39:41.474604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.474528 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xsk2h\"" Jul 01 22:39:41.480404 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.480382 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld"] Jul 01 22:39:41.551049 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.550979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.551049 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.551040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw4p5\" (UniqueName: \"kubernetes.io/projected/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-kube-api-access-cw4p5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.551221 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.551070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.651451 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.651419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw4p5\" (UniqueName: \"kubernetes.io/projected/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-kube-api-access-cw4p5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.651451 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.651455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.651641 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.651497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.651878 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.651856 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.651974 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.651893 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.659734 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.659711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw4p5\" (UniqueName: \"kubernetes.io/projected/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-kube-api-access-cw4p5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.781889 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.781860 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:41.906602 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:41.906575 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld"] Jul 01 22:39:41.910175 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:39:41.910145 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76adf54a_8fbb_43b1_b5fa_80dc7c0968cc.slice/crio-7fa6c6f9710ad36340d8792dc56589204cbfa8f265e4dd042338bf0d099e0e3e WatchSource:0}: Error finding container 7fa6c6f9710ad36340d8792dc56589204cbfa8f265e4dd042338bf0d099e0e3e: Status 404 returned error can't find the container with id 7fa6c6f9710ad36340d8792dc56589204cbfa8f265e4dd042338bf0d099e0e3e Jul 01 22:39:42.704435 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:42.704405 2561 generic.go:356] "Generic (PLEG): container finished" podID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerID="9a0891de278c083630ee405d1c6179fdef46b8a5691c137b0828a064cb11f2a0" exitCode=0 Jul 01 22:39:42.704885 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:42.704494 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" event={"ID":"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc","Type":"ContainerDied","Data":"9a0891de278c083630ee405d1c6179fdef46b8a5691c137b0828a064cb11f2a0"} Jul 01 22:39:42.704885 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:42.704542 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" event={"ID":"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc","Type":"ContainerStarted","Data":"7fa6c6f9710ad36340d8792dc56589204cbfa8f265e4dd042338bf0d099e0e3e"} Jul 01 22:39:43.710310 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:43.710278 2561 generic.go:356] "Generic (PLEG): container finished" podID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerID="018dc76321c6f96d1b05658b5acab564bb042d3badb339bcac65758467a13a53" exitCode=0 Jul 01 22:39:43.710663 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:43.710316 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" event={"ID":"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc","Type":"ContainerDied","Data":"018dc76321c6f96d1b05658b5acab564bb042d3badb339bcac65758467a13a53"} Jul 01 22:39:44.716275 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:44.716239 2561 generic.go:356] "Generic (PLEG): container finished" podID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerID="42ec21f55a4e0c197adbc9df6e1a6697806001f7d9e546094e6f464b54ef7fd9" exitCode=0 Jul 01 22:39:44.716733 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:44.716329 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" event={"ID":"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc","Type":"ContainerDied","Data":"42ec21f55a4e0c197adbc9df6e1a6697806001f7d9e546094e6f464b54ef7fd9"} Jul 01 22:39:45.853141 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:45.853116 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:45.878313 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:45.878288 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw4p5\" (UniqueName: \"kubernetes.io/projected/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-kube-api-access-cw4p5\") pod \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " Jul 01 22:39:45.878451 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:45.878326 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-util\") pod \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " Jul 01 22:39:45.880244 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:45.880220 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-kube-api-access-cw4p5" (OuterVolumeSpecName: "kube-api-access-cw4p5") pod "76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" (UID: "76adf54a-8fbb-43b1-b5fa-80dc7c0968cc"). InnerVolumeSpecName "kube-api-access-cw4p5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:39:45.887633 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:45.887604 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-util" (OuterVolumeSpecName: "util") pod "76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" (UID: "76adf54a-8fbb-43b1-b5fa-80dc7c0968cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:39:45.979125 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:45.979042 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-bundle\") pod \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\" (UID: \"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc\") " Jul 01 22:39:45.979266 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:45.979194 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw4p5\" (UniqueName: \"kubernetes.io/projected/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-kube-api-access-cw4p5\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:39:45.979266 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:45.979206 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-util\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:39:45.979735 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:45.979712 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-bundle" (OuterVolumeSpecName: "bundle") pod "76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" (UID: "76adf54a-8fbb-43b1-b5fa-80dc7c0968cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:39:46.080219 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:46.080179 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76adf54a-8fbb-43b1-b5fa-80dc7c0968cc-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:39:46.726964 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:46.726928 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" event={"ID":"76adf54a-8fbb-43b1-b5fa-80dc7c0968cc","Type":"ContainerDied","Data":"7fa6c6f9710ad36340d8792dc56589204cbfa8f265e4dd042338bf0d099e0e3e"} Jul 01 22:39:46.726964 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:46.726949 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6cvld" Jul 01 22:39:46.727167 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:46.726979 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fa6c6f9710ad36340d8792dc56589204cbfa8f265e4dd042338bf0d099e0e3e" Jul 01 22:39:53.569811 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:53.569753 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:53.726944 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:53.726909 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:54.205032 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.204991 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:54.517135 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.517023 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:54.610997 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.610950 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:54.626762 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.626730 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj"] Jul 01 22:39:54.627106 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.627091 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerName="util" Jul 01 22:39:54.627148 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.627108 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerName="util" Jul 01 22:39:54.627148 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.627126 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerName="extract" Jul 01 22:39:54.627148 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.627131 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerName="extract" Jul 01 22:39:54.627148 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.627142 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerName="pull" Jul 01 22:39:54.627270 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.627151 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerName="pull" Jul 01 22:39:54.627270 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.627208 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="76adf54a-8fbb-43b1-b5fa-80dc7c0968cc" containerName="extract" Jul 01 22:39:54.632344 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.632325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.635085 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.635065 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 22:39:54.635244 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.635227 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wft2\"" Jul 01 22:39:54.635664 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.635648 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 22:39:54.635767 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.635727 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 22:39:54.635847 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.635767 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 22:39:54.652612 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.652578 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj"] Jul 01 22:39:54.739985 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.739958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cqbf\" (UniqueName: \"kubernetes.io/projected/cd660c46-0350-464e-b96b-91fdc31eb35c-kube-api-access-9cqbf\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.740151 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.739993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cd660c46-0350-464e-b96b-91fdc31eb35c-manifests\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.740151 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.740019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd660c46-0350-464e-b96b-91fdc31eb35c-tmp\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.740151 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.740039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cd660c46-0350-464e-b96b-91fdc31eb35c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.740151 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.740129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd660c46-0350-464e-b96b-91fdc31eb35c-webhook-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.841040 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.840966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cqbf\" (UniqueName: \"kubernetes.io/projected/cd660c46-0350-464e-b96b-91fdc31eb35c-kube-api-access-9cqbf\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.841040 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.840998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cd660c46-0350-464e-b96b-91fdc31eb35c-manifests\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.841040 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.841023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd660c46-0350-464e-b96b-91fdc31eb35c-tmp\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.841244 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.841230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cd660c46-0350-464e-b96b-91fdc31eb35c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.841323 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.841301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd660c46-0350-464e-b96b-91fdc31eb35c-webhook-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.841395 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.841366 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cd660c46-0350-464e-b96b-91fdc31eb35c-manifests\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.843296 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.843266 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd660c46-0350-464e-b96b-91fdc31eb35c-tmp\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.843551 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.843532 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd660c46-0350-464e-b96b-91fdc31eb35c-webhook-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.843610 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.843533 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cd660c46-0350-464e-b96b-91fdc31eb35c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.852070 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.852048 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cqbf\" (UniqueName: \"kubernetes.io/projected/cd660c46-0350-464e-b96b-91fdc31eb35c-kube-api-access-9cqbf\") pod \"opendatahub-operator-controller-manager-d96464f6-vhjqj\" (UID: \"cd660c46-0350-464e-b96b-91fdc31eb35c\") " pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.869647 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.869625 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:54.942142 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.942117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:39:54.972953 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:54.972922 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:55.072359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:55.072329 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:55.073895 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:55.073872 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj"] Jul 01 22:39:55.075643 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:39:55.075624 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd660c46_0350_464e_b96b_91fdc31eb35c.slice/crio-0b5da8a7e60df63067396547e3c3a86eeaa9a54d224534c84caaf05cc3b3ca73 WatchSource:0}: Error finding container 0b5da8a7e60df63067396547e3c3a86eeaa9a54d224534c84caaf05cc3b3ca73: Status 404 returned error can't find the container with id 0b5da8a7e60df63067396547e3c3a86eeaa9a54d224534c84caaf05cc3b3ca73 Jul 01 22:39:55.170587 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:55.170507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:55.271409 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:55.271370 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:55.375476 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:55.375447 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:55.771979 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:55.771948 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" event={"ID":"cd660c46-0350-464e-b96b-91fdc31eb35c","Type":"ContainerStarted","Data":"0b5da8a7e60df63067396547e3c3a86eeaa9a54d224534c84caaf05cc3b3ca73"} Jul 01 22:39:58.787205 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:58.787170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" event={"ID":"cd660c46-0350-464e-b96b-91fdc31eb35c","Type":"ContainerStarted","Data":"4a164385df3d2f9113320709cb76a3f6e8abc3b2971282c8d89db81da4024702"} Jul 01 22:39:59.476012 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:59.475934 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:59.574580 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:59.574553 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:39:59.793664 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:59.793589 2561 generic.go:356] "Generic (PLEG): container finished" podID="cd660c46-0350-464e-b96b-91fdc31eb35c" containerID="4a164385df3d2f9113320709cb76a3f6e8abc3b2971282c8d89db81da4024702" exitCode=0 Jul 01 22:39:59.793664 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:39:59.793659 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" event={"ID":"cd660c46-0350-464e-b96b-91fdc31eb35c","Type":"ContainerDied","Data":"4a164385df3d2f9113320709cb76a3f6e8abc3b2971282c8d89db81da4024702"} Jul 01 22:40:00.800482 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:00.800443 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" event={"ID":"cd660c46-0350-464e-b96b-91fdc31eb35c","Type":"ContainerStarted","Data":"b587b4caa86e9e6e1b84addf4c2ec9b7fc702139067cd17df8b267ae3bf28a67"} Jul 01 22:40:00.800900 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:00.800601 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:40:00.825974 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:00.825926 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" podStartSLOduration=2.384699458 podStartE2EDuration="6.825910893s" totalImagesPullingTime="3.364101596s" totalInitContainerRuntime="1.077109839s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:39:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:40:00.823861443 +0000 UTC m=+255.387616742" watchObservedRunningTime="2026-07-01 22:40:00.825910893 +0000 UTC m=+255.389666239" Jul 01 22:40:11.808056 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:11.807977 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d96464f6-vhjqj" Jul 01 22:40:13.506939 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:13.506899 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:13.623009 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:13.622962 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:14.320164 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.320129 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9ndxz"] Jul 01 22:40:14.323718 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.323700 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:14.328982 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.328956 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 22:40:14.329141 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.329119 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ct9h5\"" Jul 01 22:40:14.367753 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.367723 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2"] Jul 01 22:40:14.370908 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.370888 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.379418 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.379397 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:40:14.379515 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.379444 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rrl59\"" Jul 01 22:40:14.380003 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.379989 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 22:40:14.380693 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.380680 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 22:40:14.380746 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.380730 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 22:40:14.380909 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.380895 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 22:40:14.398862 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.398837 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2"] Jul 01 22:40:14.399147 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.399128 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsr6k\" (UniqueName: \"kubernetes.io/projected/78bec1d2-4398-4ef7-8f8b-cb7f8636c260-kube-api-access-qsr6k\") pod \"odh-model-controller-7998c67dc4-9ndxz\" (UID: \"78bec1d2-4398-4ef7-8f8b-cb7f8636c260\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:14.399191 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.399156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78bec1d2-4398-4ef7-8f8b-cb7f8636c260-cert\") pod \"odh-model-controller-7998c67dc4-9ndxz\" (UID: \"78bec1d2-4398-4ef7-8f8b-cb7f8636c260\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:14.403352 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.403330 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9ndxz"] Jul 01 22:40:14.419234 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.419197 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:14.499819 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.499750 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/853c1ba2-d01c-4a02-8044-28b845f0f002-manager-config\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.500019 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.499828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9q5\" (UniqueName: \"kubernetes.io/projected/853c1ba2-d01c-4a02-8044-28b845f0f002-kube-api-access-jm9q5\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.500019 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.499859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/853c1ba2-d01c-4a02-8044-28b845f0f002-cert\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.500019 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.499883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/853c1ba2-d01c-4a02-8044-28b845f0f002-metrics-cert\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.500019 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.499926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsr6k\" (UniqueName: \"kubernetes.io/projected/78bec1d2-4398-4ef7-8f8b-cb7f8636c260-kube-api-access-qsr6k\") pod \"odh-model-controller-7998c67dc4-9ndxz\" (UID: \"78bec1d2-4398-4ef7-8f8b-cb7f8636c260\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:14.500019 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.499950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78bec1d2-4398-4ef7-8f8b-cb7f8636c260-cert\") pod \"odh-model-controller-7998c67dc4-9ndxz\" (UID: \"78bec1d2-4398-4ef7-8f8b-cb7f8636c260\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:14.500257 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:40:14.500089 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 01 22:40:14.500257 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:40:14.500158 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bec1d2-4398-4ef7-8f8b-cb7f8636c260-cert podName:78bec1d2-4398-4ef7-8f8b-cb7f8636c260 nodeName:}" failed. No retries permitted until 2026-07-01 22:40:15.000136893 +0000 UTC m=+269.563892187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/78bec1d2-4398-4ef7-8f8b-cb7f8636c260-cert") pod "odh-model-controller-7998c67dc4-9ndxz" (UID: "78bec1d2-4398-4ef7-8f8b-cb7f8636c260") : secret "odh-model-controller-webhook-cert" not found Jul 01 22:40:14.515236 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.515207 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsr6k\" (UniqueName: \"kubernetes.io/projected/78bec1d2-4398-4ef7-8f8b-cb7f8636c260-kube-api-access-qsr6k\") pod \"odh-model-controller-7998c67dc4-9ndxz\" (UID: \"78bec1d2-4398-4ef7-8f8b-cb7f8636c260\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:14.548103 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.548066 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:14.601179 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.601092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/853c1ba2-d01c-4a02-8044-28b845f0f002-manager-config\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.601179 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.601133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9q5\" (UniqueName: \"kubernetes.io/projected/853c1ba2-d01c-4a02-8044-28b845f0f002-kube-api-access-jm9q5\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.601179 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.601153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/853c1ba2-d01c-4a02-8044-28b845f0f002-cert\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.601432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.601348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/853c1ba2-d01c-4a02-8044-28b845f0f002-metrics-cert\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.601892 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.601869 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/853c1ba2-d01c-4a02-8044-28b845f0f002-manager-config\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.603684 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.603659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/853c1ba2-d01c-4a02-8044-28b845f0f002-cert\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.603767 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.603725 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/853c1ba2-d01c-4a02-8044-28b845f0f002-metrics-cert\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.618057 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.618029 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9q5\" (UniqueName: \"kubernetes.io/projected/853c1ba2-d01c-4a02-8044-28b845f0f002-kube-api-access-jm9q5\") pod \"lws-controller-manager-bb7dc95cc-mcvg2\" (UID: \"853c1ba2-d01c-4a02-8044-28b845f0f002\") " pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.679942 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.679905 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:14.698991 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.698964 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:14.845654 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:40:14.845625 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853c1ba2_d01c_4a02_8044_28b845f0f002.slice/crio-7d07a85ca23cb7958e0ce821e332320083c795f0dbad8bb8782e6dc77ba20692 WatchSource:0}: Error finding container 7d07a85ca23cb7958e0ce821e332320083c795f0dbad8bb8782e6dc77ba20692: Status 404 returned error can't find the container with id 7d07a85ca23cb7958e0ce821e332320083c795f0dbad8bb8782e6dc77ba20692 Jul 01 22:40:14.850148 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.850124 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2"] Jul 01 22:40:14.861334 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.861309 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:14.873322 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:14.873286 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" event={"ID":"853c1ba2-d01c-4a02-8044-28b845f0f002","Type":"ContainerStarted","Data":"7d07a85ca23cb7958e0ce821e332320083c795f0dbad8bb8782e6dc77ba20692"} Jul 01 22:40:15.004301 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:15.004260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78bec1d2-4398-4ef7-8f8b-cb7f8636c260-cert\") pod \"odh-model-controller-7998c67dc4-9ndxz\" (UID: \"78bec1d2-4398-4ef7-8f8b-cb7f8636c260\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:15.006664 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:15.006634 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78bec1d2-4398-4ef7-8f8b-cb7f8636c260-cert\") pod \"odh-model-controller-7998c67dc4-9ndxz\" (UID: \"78bec1d2-4398-4ef7-8f8b-cb7f8636c260\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:15.233109 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:15.233069 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:15.235944 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:15.235918 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:15.371428 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:15.371394 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9ndxz"] Jul 01 22:40:15.374209 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:40:15.374180 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78bec1d2_4398_4ef7_8f8b_cb7f8636c260.slice/crio-afe8156327fb5ab22dc32d7179f320e3b1ae12348863ef7f8d939ec6f7cf0467 WatchSource:0}: Error finding container afe8156327fb5ab22dc32d7179f320e3b1ae12348863ef7f8d939ec6f7cf0467: Status 404 returned error can't find the container with id afe8156327fb5ab22dc32d7179f320e3b1ae12348863ef7f8d939ec6f7cf0467 Jul 01 22:40:15.483599 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:15.483502 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:15.880266 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:15.880169 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" event={"ID":"78bec1d2-4398-4ef7-8f8b-cb7f8636c260","Type":"ContainerStarted","Data":"afe8156327fb5ab22dc32d7179f320e3b1ae12348863ef7f8d939ec6f7cf0467"} Jul 01 22:40:16.886363 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:16.886278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" event={"ID":"853c1ba2-d01c-4a02-8044-28b845f0f002","Type":"ContainerStarted","Data":"f77d74e7d56e57ba10a3dfeb06e98457313354b3c17ea671ccec3d75bce3e5c6"} Jul 01 22:40:16.886826 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:16.886402 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:16.904743 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:16.904688 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" podStartSLOduration=1.230809019 podStartE2EDuration="2.90466793s" totalImagesPullingTime="1.673858911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:40:16.903272345 +0000 UTC m=+271.467027644" watchObservedRunningTime="2026-07-01 22:40:16.90466793 +0000 UTC m=+271.468423230" Jul 01 22:40:18.900409 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:18.900373 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" event={"ID":"78bec1d2-4398-4ef7-8f8b-cb7f8636c260","Type":"ContainerStarted","Data":"f13f346907e05fc98053d961d44d1519a1e71b219855bcd3debda0a8358179c2"} Jul 01 22:40:18.900775 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:18.900449 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:18.922073 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:18.922023 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" podStartSLOduration=2.262113782 podStartE2EDuration="4.9220081s" totalImagesPullingTime="2.659894318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:40:18.920986064 +0000 UTC m=+273.484741355" watchObservedRunningTime="2026-07-01 22:40:18.9220081 +0000 UTC m=+273.485763399" Jul 01 22:40:22.404419 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:22.404383 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:22.499018 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:22.498982 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:23.912149 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:23.912114 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:23.995552 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:23.995521 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:24.087489 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:24.087455 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:24.221151 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:24.221105 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:24.697050 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:24.696927 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:25.135961 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:25.135930 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:25.238064 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:25.238034 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:25.333134 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:25.333109 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:27.285194 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:27.285154 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:27.364950 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:27.364914 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:27.894770 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:27.894741 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bb7dc95cc-mcvg2" Jul 01 22:40:28.642347 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:28.642314 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:29.906555 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:29.906522 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9ndxz" Jul 01 22:40:31.674079 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:31.674029 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:31.843449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:31.843414 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:31.944836 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:31.944743 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg"] Jul 01 22:40:31.951015 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:31.950995 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:31.953255 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:31.953231 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 22:40:31.953413 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:31.953397 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4sqwp\"" Jul 01 22:40:31.962437 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:31.962411 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg"] Jul 01 22:40:31.984367 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:31.984342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:32.047725 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.047694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.047725 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.047726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.047942 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.047754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.047942 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.047775 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.047942 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.047830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.047942 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.047880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.047942 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.047934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.048118 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.047979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tnfp\" (UniqueName: \"kubernetes.io/projected/0daf6726-2f04-4317-af4f-7940012f3dbc-kube-api-access-2tnfp\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.048118 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.048016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0daf6726-2f04-4317-af4f-7940012f3dbc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.116524 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.116473 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:32.148587 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.148713 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.148713 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.148713 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.148713 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148704 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.148937 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.148937 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.148937 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tnfp\" (UniqueName: \"kubernetes.io/projected/0daf6726-2f04-4317-af4f-7940012f3dbc-kube-api-access-2tnfp\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.148937 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148907 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0daf6726-2f04-4317-af4f-7940012f3dbc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.149129 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.148985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.149129 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.149019 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.149418 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.149393 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.149541 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.149422 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.149594 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.149568 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0daf6726-2f04-4317-af4f-7940012f3dbc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.151073 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.151053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.151623 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.151605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.160935 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.160908 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0daf6726-2f04-4317-af4f-7940012f3dbc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.161251 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.161231 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tnfp\" (UniqueName: \"kubernetes.io/projected/0daf6726-2f04-4317-af4f-7940012f3dbc-kube-api-access-2tnfp\") pod \"data-science-gateway-data-science-gateway-class-656c84dccdln9sg\" (UID: \"0daf6726-2f04-4317-af4f-7940012f3dbc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.261891 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.261857 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:32.313742 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.313655 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:40:32.401224 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.401196 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg"] Jul 01 22:40:32.401549 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:40:32.401514 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0daf6726_2f04_4317_af4f_7940012f3dbc.slice/crio-fb57b703b074c76b5a23c58b62f0d5e9ce2ce19a61299a324abba1cccb97aaff WatchSource:0}: Error finding container fb57b703b074c76b5a23c58b62f0d5e9ce2ce19a61299a324abba1cccb97aaff: Status 404 returned error can't find the container with id fb57b703b074c76b5a23c58b62f0d5e9ce2ce19a61299a324abba1cccb97aaff Jul 01 22:40:32.963970 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:32.963938 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" event={"ID":"0daf6726-2f04-4317-af4f-7940012f3dbc","Type":"ContainerStarted","Data":"fb57b703b074c76b5a23c58b62f0d5e9ce2ce19a61299a324abba1cccb97aaff"} Jul 01 22:40:35.988386 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:35.988340 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 22:40:35.988647 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:35.988432 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 22:40:35.988647 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:35.988465 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 22:40:36.982895 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:36.982860 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" event={"ID":"0daf6726-2f04-4317-af4f-7940012f3dbc","Type":"ContainerStarted","Data":"9f2e91d01d0633684642cf23c3a42381e34a9a50a92d680d30fd4de8352bbb3d"} Jul 01 22:40:37.004358 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:37.004299 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" podStartSLOduration=2.419754658 podStartE2EDuration="6.004283711s" totalImagesPullingTime="3.584529053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:40:37.002705697 +0000 UTC m=+291.566460995" watchObservedRunningTime="2026-07-01 22:40:37.004283711 +0000 UTC m=+291.568039010" Jul 01 22:40:37.262675 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:37.262602 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:37.267130 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:37.267108 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:37.987646 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:37.987609 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:37.988574 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:37.988554 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-656c84dccdln9sg" Jul 01 22:40:45.806674 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:45.806645 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/2.log" Jul 01 22:40:45.810480 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:45.810458 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/2.log" Jul 01 22:40:45.820223 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:45.820200 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgww5_903919bd-c073-460c-b4d3-b0159dfc8e6e/ovn-acl-logging/0.log" Jul 01 22:40:45.827179 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:45.827160 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgww5_903919bd-c073-460c-b4d3-b0159dfc8e6e/ovn-acl-logging/0.log" Jul 01 22:40:45.828441 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:40:45.828419 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 22:41:15.069668 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.069607 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:15.226081 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.226051 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6kg9h"] Jul 01 22:41:15.229205 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.229188 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" Jul 01 22:41:15.231928 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.231904 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 22:41:15.232078 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.232032 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 22:41:15.232585 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.232562 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jfjrs\"" Jul 01 22:41:15.239590 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.239567 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6kg9h"] Jul 01 22:41:15.312885 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.312853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th6jg\" (UniqueName: \"kubernetes.io/projected/7958dc8a-a5a2-495e-94eb-d84a7838dfbb-kube-api-access-th6jg\") pod \"kuadrant-operator-catalog-6kg9h\" (UID: \"7958dc8a-a5a2-495e-94eb-d84a7838dfbb\") " pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" Jul 01 22:41:15.413344 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.413263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th6jg\" (UniqueName: \"kubernetes.io/projected/7958dc8a-a5a2-495e-94eb-d84a7838dfbb-kube-api-access-th6jg\") pod \"kuadrant-operator-catalog-6kg9h\" (UID: \"7958dc8a-a5a2-495e-94eb-d84a7838dfbb\") " pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" Jul 01 22:41:15.423182 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.423152 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th6jg\" (UniqueName: \"kubernetes.io/projected/7958dc8a-a5a2-495e-94eb-d84a7838dfbb-kube-api-access-th6jg\") pod \"kuadrant-operator-catalog-6kg9h\" (UID: \"7958dc8a-a5a2-495e-94eb-d84a7838dfbb\") " pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" Jul 01 22:41:15.540638 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.540598 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" Jul 01 22:41:15.547959 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.547937 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6kg9h"] Jul 01 22:41:15.670644 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.670593 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6kg9h"] Jul 01 22:41:15.672890 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:41:15.672853 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7958dc8a_a5a2_495e_94eb_d84a7838dfbb.slice/crio-dd506cee924838dac4db4b10b6b5864af35e358065e9faa1bb91f9cddcec7927 WatchSource:0}: Error finding container dd506cee924838dac4db4b10b6b5864af35e358065e9faa1bb91f9cddcec7927: Status 404 returned error can't find the container with id dd506cee924838dac4db4b10b6b5864af35e358065e9faa1bb91f9cddcec7927 Jul 01 22:41:15.674358 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.674339 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:41:15.747780 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.747752 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2dsj8"] Jul 01 22:41:15.752046 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.752019 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" Jul 01 22:41:15.761197 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.761173 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2dsj8"] Jul 01 22:41:15.815958 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.815929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4s2t\" (UniqueName: \"kubernetes.io/projected/d43917ba-fbec-4bc3-9f50-5d8c990b1a8a-kube-api-access-n4s2t\") pod \"kuadrant-operator-catalog-2dsj8\" (UID: \"d43917ba-fbec-4bc3-9f50-5d8c990b1a8a\") " pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" Jul 01 22:41:15.916496 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.916466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4s2t\" (UniqueName: \"kubernetes.io/projected/d43917ba-fbec-4bc3-9f50-5d8c990b1a8a-kube-api-access-n4s2t\") pod \"kuadrant-operator-catalog-2dsj8\" (UID: \"d43917ba-fbec-4bc3-9f50-5d8c990b1a8a\") " pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" Jul 01 22:41:15.924151 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:15.924093 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4s2t\" (UniqueName: \"kubernetes.io/projected/d43917ba-fbec-4bc3-9f50-5d8c990b1a8a-kube-api-access-n4s2t\") pod \"kuadrant-operator-catalog-2dsj8\" (UID: \"d43917ba-fbec-4bc3-9f50-5d8c990b1a8a\") " pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" Jul 01 22:41:16.064048 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:16.064010 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" Jul 01 22:41:16.166412 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:16.166368 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" event={"ID":"7958dc8a-a5a2-495e-94eb-d84a7838dfbb","Type":"ContainerStarted","Data":"dd506cee924838dac4db4b10b6b5864af35e358065e9faa1bb91f9cddcec7927"} Jul 01 22:41:16.198590 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:16.198567 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2dsj8"] Jul 01 22:41:16.200282 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:41:16.200261 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43917ba_fbec_4bc3_9f50_5d8c990b1a8a.slice/crio-e3f9ec81e688ddeab915a8d18e7c6f6a9137d70286ffb92de8eb537026ac8358 WatchSource:0}: Error finding container e3f9ec81e688ddeab915a8d18e7c6f6a9137d70286ffb92de8eb537026ac8358: Status 404 returned error can't find the container with id e3f9ec81e688ddeab915a8d18e7c6f6a9137d70286ffb92de8eb537026ac8358 Jul 01 22:41:16.389704 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:16.389669 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:17.172691 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:17.172652 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" event={"ID":"d43917ba-fbec-4bc3-9f50-5d8c990b1a8a","Type":"ContainerStarted","Data":"e3f9ec81e688ddeab915a8d18e7c6f6a9137d70286ffb92de8eb537026ac8358"} Jul 01 22:41:18.179210 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:18.179174 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" event={"ID":"d43917ba-fbec-4bc3-9f50-5d8c990b1a8a","Type":"ContainerStarted","Data":"62eb0c13b913a723d777dd2483d156aa4d64cf1cd2557c8913f488500c9395e0"} Jul 01 22:41:18.180585 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:18.180553 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" event={"ID":"7958dc8a-a5a2-495e-94eb-d84a7838dfbb","Type":"ContainerStarted","Data":"d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da"} Jul 01 22:41:18.180701 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:18.180656 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" podUID="7958dc8a-a5a2-495e-94eb-d84a7838dfbb" containerName="registry-server" containerID="cri-o://d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da" gracePeriod=2 Jul 01 22:41:18.195467 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:18.195420 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" podStartSLOduration=1.797356199 podStartE2EDuration="3.19540735s" totalImagesPullingTime="1.398051151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:41:18.195080364 +0000 UTC m=+332.758835664" watchObservedRunningTime="2026-07-01 22:41:18.19540735 +0000 UTC m=+332.759162649" Jul 01 22:41:18.211419 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:18.211376 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" podStartSLOduration=1.286806057 podStartE2EDuration="3.211362235s" totalImagesPullingTime="1.924556178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:41:18.210503262 +0000 UTC m=+332.774258561" watchObservedRunningTime="2026-07-01 22:41:18.211362235 +0000 UTC m=+332.775117533" Jul 01 22:41:18.422430 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:18.422404 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" Jul 01 22:41:18.539734 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:18.539705 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th6jg\" (UniqueName: \"kubernetes.io/projected/7958dc8a-a5a2-495e-94eb-d84a7838dfbb-kube-api-access-th6jg\") pod \"7958dc8a-a5a2-495e-94eb-d84a7838dfbb\" (UID: \"7958dc8a-a5a2-495e-94eb-d84a7838dfbb\") " Jul 01 22:41:18.541809 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:18.541772 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7958dc8a-a5a2-495e-94eb-d84a7838dfbb-kube-api-access-th6jg" (OuterVolumeSpecName: "kube-api-access-th6jg") pod "7958dc8a-a5a2-495e-94eb-d84a7838dfbb" (UID: "7958dc8a-a5a2-495e-94eb-d84a7838dfbb"). InnerVolumeSpecName "kube-api-access-th6jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:41:18.640511 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:18.640479 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th6jg\" (UniqueName: \"kubernetes.io/projected/7958dc8a-a5a2-495e-94eb-d84a7838dfbb-kube-api-access-th6jg\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:19.186430 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.186397 2561 generic.go:356] "Generic (PLEG): container finished" podID="7958dc8a-a5a2-495e-94eb-d84a7838dfbb" containerID="d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da" exitCode=0 Jul 01 22:41:19.186911 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.186453 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" Jul 01 22:41:19.186911 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.186491 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" event={"ID":"7958dc8a-a5a2-495e-94eb-d84a7838dfbb","Type":"ContainerDied","Data":"d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da"} Jul 01 22:41:19.186911 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.186543 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6kg9h" event={"ID":"7958dc8a-a5a2-495e-94eb-d84a7838dfbb","Type":"ContainerDied","Data":"dd506cee924838dac4db4b10b6b5864af35e358065e9faa1bb91f9cddcec7927"} Jul 01 22:41:19.186911 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.186564 2561 scope.go:117] "RemoveContainer" containerID="d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da" Jul 01 22:41:19.195250 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.195235 2561 scope.go:117] "RemoveContainer" containerID="d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da" Jul 01 22:41:19.195478 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:41:19.195460 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da\": container with ID starting with d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da not found: ID does not exist" containerID="d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da" Jul 01 22:41:19.195522 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.195486 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da"} err="failed to get container status \"d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da\": rpc error: code = NotFound desc = could not find container \"d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da\": container with ID starting with d8caeb112188d79d8af44192f6c8965554edbf7f18a5bd12c0f5a0db122711da not found: ID does not exist" Jul 01 22:41:19.208255 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.208231 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6kg9h"] Jul 01 22:41:19.211782 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.211762 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6kg9h"] Jul 01 22:41:19.871517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:19.871487 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7958dc8a-a5a2-495e-94eb-d84a7838dfbb" path="/var/lib/kubelet/pods/7958dc8a-a5a2-495e-94eb-d84a7838dfbb/volumes" Jul 01 22:41:23.274605 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:23.274571 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:23.334754 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:23.334719 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:26.064396 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:26.064362 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" Jul 01 22:41:26.064837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:26.064430 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" Jul 01 22:41:26.086654 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:26.086633 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" Jul 01 22:41:26.243697 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:26.243668 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2dsj8" Jul 01 22:41:30.522837 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.522803 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q"] Jul 01 22:41:30.523212 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.523150 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7958dc8a-a5a2-495e-94eb-d84a7838dfbb" containerName="registry-server" Jul 01 22:41:30.523212 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.523160 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7958dc8a-a5a2-495e-94eb-d84a7838dfbb" containerName="registry-server" Jul 01 22:41:30.523283 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.523224 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7958dc8a-a5a2-495e-94eb-d84a7838dfbb" containerName="registry-server" Jul 01 22:41:30.527652 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.527633 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.530311 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.530280 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v42kk\"" Jul 01 22:41:30.538023 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.538002 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q"] Jul 01 22:41:30.637890 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.637854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.637890 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.637891 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m5hc\" (UniqueName: \"kubernetes.io/projected/81cd78ac-90c6-4b24-b092-e09a90fb6108-kube-api-access-4m5hc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.638095 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.637966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.739027 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.738987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.739193 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.739053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.739193 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.739072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m5hc\" (UniqueName: \"kubernetes.io/projected/81cd78ac-90c6-4b24-b092-e09a90fb6108-kube-api-access-4m5hc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.739407 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.739387 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.739447 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.739415 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.747909 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.747880 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m5hc\" (UniqueName: \"kubernetes.io/projected/81cd78ac-90c6-4b24-b092-e09a90fb6108-kube-api-access-4m5hc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.836713 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.836627 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:30.965862 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:30.965836 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q"] Jul 01 22:41:30.967733 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:41:30.967708 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81cd78ac_90c6_4b24_b092_e09a90fb6108.slice/crio-6f6883fc7887e6bde3aab28f84bc602992696c83f1a6311f2f5b7472045cd5f3 WatchSource:0}: Error finding container 6f6883fc7887e6bde3aab28f84bc602992696c83f1a6311f2f5b7472045cd5f3: Status 404 returned error can't find the container with id 6f6883fc7887e6bde3aab28f84bc602992696c83f1a6311f2f5b7472045cd5f3 Jul 01 22:41:31.117227 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.117160 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb"] Jul 01 22:41:31.120391 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.120374 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.129003 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.128977 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb"] Jul 01 22:41:31.242539 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.242508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8zn\" (UniqueName: \"kubernetes.io/projected/82475db3-880f-46a1-8535-5974dd539738-kube-api-access-bw8zn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.242710 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.242552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.242710 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.242585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.247729 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.247693 2561 generic.go:356] "Generic (PLEG): container finished" podID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerID="11385ef7c4667df84a3eaca49ceb6cafd94e1fffaecc990f6991dc3a34439f51" exitCode=0 Jul 01 22:41:31.247894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.247730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" event={"ID":"81cd78ac-90c6-4b24-b092-e09a90fb6108","Type":"ContainerDied","Data":"11385ef7c4667df84a3eaca49ceb6cafd94e1fffaecc990f6991dc3a34439f51"} Jul 01 22:41:31.247894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.247772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" event={"ID":"81cd78ac-90c6-4b24-b092-e09a90fb6108","Type":"ContainerStarted","Data":"6f6883fc7887e6bde3aab28f84bc602992696c83f1a6311f2f5b7472045cd5f3"} Jul 01 22:41:31.344058 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.344024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8zn\" (UniqueName: \"kubernetes.io/projected/82475db3-880f-46a1-8535-5974dd539738-kube-api-access-bw8zn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.344205 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.344072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.344205 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.344107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.344455 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.344439 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.344493 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.344470 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.352188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.352166 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8zn\" (UniqueName: \"kubernetes.io/projected/82475db3-880f-46a1-8535-5974dd539738-kube-api-access-bw8zn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.429536 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.429459 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:31.558883 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.558859 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb"] Jul 01 22:41:31.561303 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:41:31.561262 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82475db3_880f_46a1_8535_5974dd539738.slice/crio-b069e6934ea9b3c9468d151de923a34663e58f11ea3f9bdeaf033a8c2e1aec80 WatchSource:0}: Error finding container b069e6934ea9b3c9468d151de923a34663e58f11ea3f9bdeaf033a8c2e1aec80: Status 404 returned error can't find the container with id b069e6934ea9b3c9468d151de923a34663e58f11ea3f9bdeaf033a8c2e1aec80 Jul 01 22:41:31.713780 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.713754 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4"] Jul 01 22:41:31.717126 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.717106 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:31.726464 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.726442 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4"] Jul 01 22:41:31.847512 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.847461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:31.847512 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.847528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqml\" (UniqueName: \"kubernetes.io/projected/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-kube-api-access-wzqml\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:31.847781 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.847672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:31.948254 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.948217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqml\" (UniqueName: \"kubernetes.io/projected/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-kube-api-access-wzqml\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:31.948392 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.948361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:31.948468 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.948451 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:31.948767 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.948746 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:31.948878 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.948787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:31.957143 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:31.957119 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqml\" (UniqueName: \"kubernetes.io/projected/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-kube-api-access-wzqml\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:32.031472 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.031443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:32.116753 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.116525 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn"] Jul 01 22:41:32.121898 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.120242 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.131057 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.131031 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn"] Jul 01 22:41:32.173848 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.173823 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4"] Jul 01 22:41:32.198753 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:41:32.198709 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f376cc4_9c00_4e56_b4f5_72611eda0ac3.slice/crio-d62dd708e025cd0b22f82b344deb52c628496537b04469ad79017b812890e413 WatchSource:0}: Error finding container d62dd708e025cd0b22f82b344deb52c628496537b04469ad79017b812890e413: Status 404 returned error can't find the container with id d62dd708e025cd0b22f82b344deb52c628496537b04469ad79017b812890e413 Jul 01 22:41:32.251846 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.251769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.258033 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.252582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.258033 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.252708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgd45\" (UniqueName: \"kubernetes.io/projected/51336f41-49f9-4c5c-99d4-f96c593c7c54-kube-api-access-qgd45\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.261228 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.261194 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" event={"ID":"7f376cc4-9c00-4e56-b4f5-72611eda0ac3","Type":"ContainerStarted","Data":"fd296211eb81774c49ead2e1a0de943c0a2cb776366a1a0280f46c277e0da89e"} Jul 01 22:41:32.261322 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.261285 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" event={"ID":"7f376cc4-9c00-4e56-b4f5-72611eda0ac3","Type":"ContainerStarted","Data":"d62dd708e025cd0b22f82b344deb52c628496537b04469ad79017b812890e413"} Jul 01 22:41:32.263097 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.263076 2561 generic.go:356] "Generic (PLEG): container finished" podID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerID="a3c194c84cdf53d8e68510c8205396bc10fa14bbcf9e9f081b542886b4cbb54d" exitCode=0 Jul 01 22:41:32.263195 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.263159 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" event={"ID":"81cd78ac-90c6-4b24-b092-e09a90fb6108","Type":"ContainerDied","Data":"a3c194c84cdf53d8e68510c8205396bc10fa14bbcf9e9f081b542886b4cbb54d"} Jul 01 22:41:32.264903 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.264878 2561 generic.go:356] "Generic (PLEG): container finished" podID="82475db3-880f-46a1-8535-5974dd539738" containerID="9d34b6618c4f50a50acc349ca37d13c3234e986252a0eda1a3babb0f30b766ff" exitCode=0 Jul 01 22:41:32.265006 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.264927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" event={"ID":"82475db3-880f-46a1-8535-5974dd539738","Type":"ContainerDied","Data":"9d34b6618c4f50a50acc349ca37d13c3234e986252a0eda1a3babb0f30b766ff"} Jul 01 22:41:32.265006 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.264961 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" event={"ID":"82475db3-880f-46a1-8535-5974dd539738","Type":"ContainerStarted","Data":"b069e6934ea9b3c9468d151de923a34663e58f11ea3f9bdeaf033a8c2e1aec80"} Jul 01 22:41:32.353775 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.353753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgd45\" (UniqueName: \"kubernetes.io/projected/51336f41-49f9-4c5c-99d4-f96c593c7c54-kube-api-access-qgd45\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.353904 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.353893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.353951 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.353914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.354296 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.354273 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.354296 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.354285 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.376327 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.376298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgd45\" (UniqueName: \"kubernetes.io/projected/51336f41-49f9-4c5c-99d4-f96c593c7c54-kube-api-access-qgd45\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.505038 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.504964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:32.636657 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:32.636632 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn"] Jul 01 22:41:32.638383 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:41:32.638357 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51336f41_49f9_4c5c_99d4_f96c593c7c54.slice/crio-3863d0b0b236abd7782e9b2db235565770a9f4d0f8aeb275a45e5d4b6a018177 WatchSource:0}: Error finding container 3863d0b0b236abd7782e9b2db235565770a9f4d0f8aeb275a45e5d4b6a018177: Status 404 returned error can't find the container with id 3863d0b0b236abd7782e9b2db235565770a9f4d0f8aeb275a45e5d4b6a018177 Jul 01 22:41:33.272372 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:33.272280 2561 generic.go:356] "Generic (PLEG): container finished" podID="82475db3-880f-46a1-8535-5974dd539738" containerID="5c44ee60926d3464005e608a80b5a73cbbca754c61fe1941c92ce2bace7bfcdd" exitCode=0 Jul 01 22:41:33.272539 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:33.272365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" event={"ID":"82475db3-880f-46a1-8535-5974dd539738","Type":"ContainerDied","Data":"5c44ee60926d3464005e608a80b5a73cbbca754c61fe1941c92ce2bace7bfcdd"} Jul 01 22:41:33.273908 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:33.273886 2561 generic.go:356] "Generic (PLEG): container finished" podID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerID="b0086e2f9b1b41d5c93a1793d7dbf6cad6c2bfd8966f962dffc09f54d69f120c" exitCode=0 Jul 01 22:41:33.274027 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:33.273973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" event={"ID":"51336f41-49f9-4c5c-99d4-f96c593c7c54","Type":"ContainerDied","Data":"b0086e2f9b1b41d5c93a1793d7dbf6cad6c2bfd8966f962dffc09f54d69f120c"} Jul 01 22:41:33.274027 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:33.274007 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" event={"ID":"51336f41-49f9-4c5c-99d4-f96c593c7c54","Type":"ContainerStarted","Data":"3863d0b0b236abd7782e9b2db235565770a9f4d0f8aeb275a45e5d4b6a018177"} Jul 01 22:41:33.275692 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:33.275667 2561 generic.go:356] "Generic (PLEG): container finished" podID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerID="fd296211eb81774c49ead2e1a0de943c0a2cb776366a1a0280f46c277e0da89e" exitCode=0 Jul 01 22:41:33.275832 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:33.275809 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" event={"ID":"7f376cc4-9c00-4e56-b4f5-72611eda0ac3","Type":"ContainerDied","Data":"fd296211eb81774c49ead2e1a0de943c0a2cb776366a1a0280f46c277e0da89e"} Jul 01 22:41:33.278114 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:33.278085 2561 generic.go:356] "Generic (PLEG): container finished" podID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerID="3685899d0d9997c6f3bb622b6ea1685ee6307624273d690da67f4f46f553e94f" exitCode=0 Jul 01 22:41:33.278215 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:33.278128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" event={"ID":"81cd78ac-90c6-4b24-b092-e09a90fb6108","Type":"ContainerDied","Data":"3685899d0d9997c6f3bb622b6ea1685ee6307624273d690da67f4f46f553e94f"} Jul 01 22:41:34.286363 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.286288 2561 generic.go:356] "Generic (PLEG): container finished" podID="82475db3-880f-46a1-8535-5974dd539738" containerID="e8add35f8501c404bd428e6bf68b6dbff479509e7ad5f846bccba862774f7864" exitCode=0 Jul 01 22:41:34.286738 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.286362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" event={"ID":"82475db3-880f-46a1-8535-5974dd539738","Type":"ContainerDied","Data":"e8add35f8501c404bd428e6bf68b6dbff479509e7ad5f846bccba862774f7864"} Jul 01 22:41:34.288329 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.288295 2561 generic.go:356] "Generic (PLEG): container finished" podID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerID="b16c52e2eaaef7a5d4511ab101034b49c84ed972eae773ec2a76d3da9ec8070e" exitCode=0 Jul 01 22:41:34.288511 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.288402 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" event={"ID":"51336f41-49f9-4c5c-99d4-f96c593c7c54","Type":"ContainerDied","Data":"b16c52e2eaaef7a5d4511ab101034b49c84ed972eae773ec2a76d3da9ec8070e"} Jul 01 22:41:34.434175 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.434152 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:34.574348 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.574272 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m5hc\" (UniqueName: \"kubernetes.io/projected/81cd78ac-90c6-4b24-b092-e09a90fb6108-kube-api-access-4m5hc\") pod \"81cd78ac-90c6-4b24-b092-e09a90fb6108\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " Jul 01 22:41:34.574348 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.574314 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-util\") pod \"81cd78ac-90c6-4b24-b092-e09a90fb6108\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " Jul 01 22:41:34.574348 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.574347 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-bundle\") pod \"81cd78ac-90c6-4b24-b092-e09a90fb6108\" (UID: \"81cd78ac-90c6-4b24-b092-e09a90fb6108\") " Jul 01 22:41:34.574886 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.574860 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-bundle" (OuterVolumeSpecName: "bundle") pod "81cd78ac-90c6-4b24-b092-e09a90fb6108" (UID: "81cd78ac-90c6-4b24-b092-e09a90fb6108"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:41:34.576378 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.576356 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81cd78ac-90c6-4b24-b092-e09a90fb6108-kube-api-access-4m5hc" (OuterVolumeSpecName: "kube-api-access-4m5hc") pod "81cd78ac-90c6-4b24-b092-e09a90fb6108" (UID: "81cd78ac-90c6-4b24-b092-e09a90fb6108"). InnerVolumeSpecName "kube-api-access-4m5hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:41:34.579652 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.579631 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-util" (OuterVolumeSpecName: "util") pod "81cd78ac-90c6-4b24-b092-e09a90fb6108" (UID: "81cd78ac-90c6-4b24-b092-e09a90fb6108"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:41:34.676052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.676004 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m5hc\" (UniqueName: \"kubernetes.io/projected/81cd78ac-90c6-4b24-b092-e09a90fb6108-kube-api-access-4m5hc\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:34.676052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.676045 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-util\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:34.676052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:34.676055 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd78ac-90c6-4b24-b092-e09a90fb6108-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:35.295782 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.295747 2561 generic.go:356] "Generic (PLEG): container finished" podID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerID="018b3a700015ebb85a8dbb7d54aaba2b6538a6e24dc20d7a5a5020e0bb2a5b94" exitCode=0 Jul 01 22:41:35.296135 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.295825 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" event={"ID":"51336f41-49f9-4c5c-99d4-f96c593c7c54","Type":"ContainerDied","Data":"018b3a700015ebb85a8dbb7d54aaba2b6538a6e24dc20d7a5a5020e0bb2a5b94"} Jul 01 22:41:35.297549 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.297527 2561 generic.go:356] "Generic (PLEG): container finished" podID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerID="939cdea72557b6ef3948d5cb28ae2278777029e3aa6a855bb8898c7c9f6c8de1" exitCode=0 Jul 01 22:41:35.297671 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.297615 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" event={"ID":"7f376cc4-9c00-4e56-b4f5-72611eda0ac3","Type":"ContainerDied","Data":"939cdea72557b6ef3948d5cb28ae2278777029e3aa6a855bb8898c7c9f6c8de1"} Jul 01 22:41:35.299515 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.299493 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" event={"ID":"81cd78ac-90c6-4b24-b092-e09a90fb6108","Type":"ContainerDied","Data":"6f6883fc7887e6bde3aab28f84bc602992696c83f1a6311f2f5b7472045cd5f3"} Jul 01 22:41:35.299607 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.299533 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f6883fc7887e6bde3aab28f84bc602992696c83f1a6311f2f5b7472045cd5f3" Jul 01 22:41:35.299607 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.299546 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q" Jul 01 22:41:35.431275 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.431253 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:35.583303 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.583215 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw8zn\" (UniqueName: \"kubernetes.io/projected/82475db3-880f-46a1-8535-5974dd539738-kube-api-access-bw8zn\") pod \"82475db3-880f-46a1-8535-5974dd539738\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " Jul 01 22:41:35.583303 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.583255 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-util\") pod \"82475db3-880f-46a1-8535-5974dd539738\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " Jul 01 22:41:35.583303 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.583285 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-bundle\") pod \"82475db3-880f-46a1-8535-5974dd539738\" (UID: \"82475db3-880f-46a1-8535-5974dd539738\") " Jul 01 22:41:35.584027 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.583994 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-bundle" (OuterVolumeSpecName: "bundle") pod "82475db3-880f-46a1-8535-5974dd539738" (UID: "82475db3-880f-46a1-8535-5974dd539738"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:41:35.585364 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.585340 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82475db3-880f-46a1-8535-5974dd539738-kube-api-access-bw8zn" (OuterVolumeSpecName: "kube-api-access-bw8zn") pod "82475db3-880f-46a1-8535-5974dd539738" (UID: "82475db3-880f-46a1-8535-5974dd539738"). InnerVolumeSpecName "kube-api-access-bw8zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:41:35.588283 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.588261 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-util" (OuterVolumeSpecName: "util") pod "82475db3-880f-46a1-8535-5974dd539738" (UID: "82475db3-880f-46a1-8535-5974dd539738"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:41:35.684062 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.684028 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw8zn\" (UniqueName: \"kubernetes.io/projected/82475db3-880f-46a1-8535-5974dd539738-kube-api-access-bw8zn\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:35.684062 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.684058 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-util\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:35.684062 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:35.684068 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82475db3-880f-46a1-8535-5974dd539738-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:36.307434 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.307403 2561 generic.go:356] "Generic (PLEG): container finished" podID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerID="d8d3a1ca9ddfbd1a168cd04b0e80c6760193308c4684c035f58687af2b9c4c50" exitCode=0 Jul 01 22:41:36.307884 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.307474 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" event={"ID":"7f376cc4-9c00-4e56-b4f5-72611eda0ac3","Type":"ContainerDied","Data":"d8d3a1ca9ddfbd1a168cd04b0e80c6760193308c4684c035f58687af2b9c4c50"} Jul 01 22:41:36.309400 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.309385 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" Jul 01 22:41:36.309490 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.309414 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb" event={"ID":"82475db3-880f-46a1-8535-5974dd539738","Type":"ContainerDied","Data":"b069e6934ea9b3c9468d151de923a34663e58f11ea3f9bdeaf033a8c2e1aec80"} Jul 01 22:41:36.309490 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.309449 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b069e6934ea9b3c9468d151de923a34663e58f11ea3f9bdeaf033a8c2e1aec80" Jul 01 22:41:36.439048 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.439024 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:36.591533 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.591441 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgd45\" (UniqueName: \"kubernetes.io/projected/51336f41-49f9-4c5c-99d4-f96c593c7c54-kube-api-access-qgd45\") pod \"51336f41-49f9-4c5c-99d4-f96c593c7c54\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " Jul 01 22:41:36.591533 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.591527 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-bundle\") pod \"51336f41-49f9-4c5c-99d4-f96c593c7c54\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " Jul 01 22:41:36.591752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.591589 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-util\") pod \"51336f41-49f9-4c5c-99d4-f96c593c7c54\" (UID: \"51336f41-49f9-4c5c-99d4-f96c593c7c54\") " Jul 01 22:41:36.592057 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.592028 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-bundle" (OuterVolumeSpecName: "bundle") pod "51336f41-49f9-4c5c-99d4-f96c593c7c54" (UID: "51336f41-49f9-4c5c-99d4-f96c593c7c54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:41:36.593508 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.593487 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51336f41-49f9-4c5c-99d4-f96c593c7c54-kube-api-access-qgd45" (OuterVolumeSpecName: "kube-api-access-qgd45") pod "51336f41-49f9-4c5c-99d4-f96c593c7c54" (UID: "51336f41-49f9-4c5c-99d4-f96c593c7c54"). InnerVolumeSpecName "kube-api-access-qgd45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:41:36.599592 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.599568 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-util" (OuterVolumeSpecName: "util") pod "51336f41-49f9-4c5c-99d4-f96c593c7c54" (UID: "51336f41-49f9-4c5c-99d4-f96c593c7c54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:41:36.692730 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.692703 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:36.692730 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.692726 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51336f41-49f9-4c5c-99d4-f96c593c7c54-util\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:36.692730 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:36.692736 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgd45\" (UniqueName: \"kubernetes.io/projected/51336f41-49f9-4c5c-99d4-f96c593c7c54-kube-api-access-qgd45\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:37.321809 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.321760 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" event={"ID":"51336f41-49f9-4c5c-99d4-f96c593c7c54","Type":"ContainerDied","Data":"3863d0b0b236abd7782e9b2db235565770a9f4d0f8aeb275a45e5d4b6a018177"} Jul 01 22:41:37.321809 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.321809 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn" Jul 01 22:41:37.322191 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.321849 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3863d0b0b236abd7782e9b2db235565770a9f4d0f8aeb275a45e5d4b6a018177" Jul 01 22:41:37.453967 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.453942 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:37.601071 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.600990 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-bundle\") pod \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " Jul 01 22:41:37.601071 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.601057 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzqml\" (UniqueName: \"kubernetes.io/projected/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-kube-api-access-wzqml\") pod \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " Jul 01 22:41:37.601292 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.601087 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-util\") pod \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\" (UID: \"7f376cc4-9c00-4e56-b4f5-72611eda0ac3\") " Jul 01 22:41:37.601501 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.601475 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-bundle" (OuterVolumeSpecName: "bundle") pod "7f376cc4-9c00-4e56-b4f5-72611eda0ac3" (UID: "7f376cc4-9c00-4e56-b4f5-72611eda0ac3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:41:37.603148 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.603125 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-kube-api-access-wzqml" (OuterVolumeSpecName: "kube-api-access-wzqml") pod "7f376cc4-9c00-4e56-b4f5-72611eda0ac3" (UID: "7f376cc4-9c00-4e56-b4f5-72611eda0ac3"). InnerVolumeSpecName "kube-api-access-wzqml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:41:37.606247 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.606226 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-util" (OuterVolumeSpecName: "util") pod "7f376cc4-9c00-4e56-b4f5-72611eda0ac3" (UID: "7f376cc4-9c00-4e56-b4f5-72611eda0ac3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:41:37.702171 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.702137 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:37.702171 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.702171 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzqml\" (UniqueName: \"kubernetes.io/projected/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-kube-api-access-wzqml\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:37.702171 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:37.702182 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f376cc4-9c00-4e56-b4f5-72611eda0ac3-util\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:41:38.327951 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:38.327927 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" Jul 01 22:41:38.327951 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:38.327946 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4" event={"ID":"7f376cc4-9c00-4e56-b4f5-72611eda0ac3","Type":"ContainerDied","Data":"d62dd708e025cd0b22f82b344deb52c628496537b04469ad79017b812890e413"} Jul 01 22:41:38.328376 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:38.327993 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d62dd708e025cd0b22f82b344deb52c628496537b04469ad79017b812890e413" Jul 01 22:41:44.160061 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:44.160019 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:49.382975 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.382935 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx"] Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383305 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerName="extract" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383317 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerName="extract" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383325 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerName="pull" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383331 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerName="pull" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383339 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerName="extract" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383345 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerName="extract" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383360 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerName="util" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383368 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerName="util" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383376 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerName="util" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383381 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerName="util" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383386 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82475db3-880f-46a1-8535-5974dd539738" containerName="extract" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383391 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="82475db3-880f-46a1-8535-5974dd539738" containerName="extract" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383398 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerName="pull" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383403 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerName="pull" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383408 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerName="util" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383413 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerName="util" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383418 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82475db3-880f-46a1-8535-5974dd539738" containerName="pull" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383423 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="82475db3-880f-46a1-8535-5974dd539738" containerName="pull" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383436 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerName="extract" Jul 01 22:41:49.383438 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383444 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerName="extract" Jul 01 22:41:49.384326 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383451 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerName="pull" Jul 01 22:41:49.384326 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383456 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerName="pull" Jul 01 22:41:49.384326 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383465 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82475db3-880f-46a1-8535-5974dd539738" containerName="util" Jul 01 22:41:49.384326 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383470 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="82475db3-880f-46a1-8535-5974dd539738" containerName="util" Jul 01 22:41:49.384326 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383519 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="51336f41-49f9-4c5c-99d4-f96c593c7c54" containerName="extract" Jul 01 22:41:49.384326 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383531 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f376cc4-9c00-4e56-b4f5-72611eda0ac3" containerName="extract" Jul 01 22:41:49.384326 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383536 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="82475db3-880f-46a1-8535-5974dd539738" containerName="extract" Jul 01 22:41:49.384326 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.383544 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="81cd78ac-90c6-4b24-b092-e09a90fb6108" containerName="extract" Jul 01 22:41:49.389758 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.389738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:41:49.392961 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.392933 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m6tdr\"" Jul 01 22:41:49.396771 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.396747 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx"] Jul 01 22:41:49.501887 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.501841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" (UID: \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:41:49.501887 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.501893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7l9\" (UniqueName: \"kubernetes.io/projected/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-kube-api-access-ws7l9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" (UID: \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:41:49.524439 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.524395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:49.603087 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.603042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" (UID: \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:41:49.603087 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.603093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7l9\" (UniqueName: \"kubernetes.io/projected/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-kube-api-access-ws7l9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" (UID: \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:41:49.603461 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.603437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" (UID: \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:41:49.612717 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.612686 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7l9\" (UniqueName: \"kubernetes.io/projected/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-kube-api-access-ws7l9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" (UID: \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:41:49.701385 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.701353 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:41:49.849944 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:49.849909 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx"] Jul 01 22:41:49.853652 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:41:49.853622 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbc169b_1cba_4f1c_ab4e_b1f0fcd25d94.slice/crio-4159aae48818de039f937afc124acbb45b9cf6a0c2bd0ae4d42eeb66a24bc71a WatchSource:0}: Error finding container 4159aae48818de039f937afc124acbb45b9cf6a0c2bd0ae4d42eeb66a24bc71a: Status 404 returned error can't find the container with id 4159aae48818de039f937afc124acbb45b9cf6a0c2bd0ae4d42eeb66a24bc71a Jul 01 22:41:50.274069 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:50.274036 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:50.393970 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:50.393933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" event={"ID":"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94","Type":"ContainerStarted","Data":"4159aae48818de039f937afc124acbb45b9cf6a0c2bd0ae4d42eeb66a24bc71a"} Jul 01 22:41:52.190269 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.190235 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d"] Jul 01 22:41:52.196463 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.196442 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:41:52.200589 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.200568 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-skr8t\"" Jul 01 22:41:52.216131 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.216104 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d"] Jul 01 22:41:52.328190 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.328153 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m54f\" (UniqueName: \"kubernetes.io/projected/75680bc0-a155-4c32-afbc-503e105a0d81-kube-api-access-8m54f\") pod \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" (UID: \"75680bc0-a155-4c32-afbc-503e105a0d81\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:41:52.429442 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.429402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m54f\" (UniqueName: \"kubernetes.io/projected/75680bc0-a155-4c32-afbc-503e105a0d81-kube-api-access-8m54f\") pod \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" (UID: \"75680bc0-a155-4c32-afbc-503e105a0d81\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:41:52.437994 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.437962 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m54f\" (UniqueName: \"kubernetes.io/projected/75680bc0-a155-4c32-afbc-503e105a0d81-kube-api-access-8m54f\") pod \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" (UID: \"75680bc0-a155-4c32-afbc-503e105a0d81\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:41:52.506742 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.506703 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:41:52.658506 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.658478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d"] Jul 01 22:41:52.660503 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:41:52.660477 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75680bc0_a155_4c32_afbc_503e105a0d81.slice/crio-b879d99738774aac7e2b9ffae9020d62266c06d539c1341b9954c1c2bce68214 WatchSource:0}: Error finding container b879d99738774aac7e2b9ffae9020d62266c06d539c1341b9954c1c2bce68214: Status 404 returned error can't find the container with id b879d99738774aac7e2b9ffae9020d62266c06d539c1341b9954c1c2bce68214 Jul 01 22:41:52.780105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:52.780000 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:53.424205 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:53.424165 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" event={"ID":"75680bc0-a155-4c32-afbc-503e105a0d81","Type":"ContainerStarted","Data":"b879d99738774aac7e2b9ffae9020d62266c06d539c1341b9954c1c2bce68214"} Jul 01 22:41:53.822564 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:53.822520 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:54.965355 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:54.965310 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:55.580107 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:55.580071 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:56.060288 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:56.060250 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:56.447258 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:56.447164 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" event={"ID":"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94","Type":"ContainerStarted","Data":"f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc"} Jul 01 22:41:56.447415 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:56.447396 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:41:56.448860 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:56.448837 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" event={"ID":"75680bc0-a155-4c32-afbc-503e105a0d81","Type":"ContainerStarted","Data":"3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c"} Jul 01 22:41:56.448971 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:56.448891 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:41:56.469414 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:56.469350 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" podStartSLOduration=1.898830272 podStartE2EDuration="7.469335401s" totalImagesPullingTime="5.570505129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:41:56.467486429 +0000 UTC m=+371.031241729" watchObservedRunningTime="2026-07-01 22:41:56.469335401 +0000 UTC m=+371.033090700" Jul 01 22:41:56.489136 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:56.489085 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" podStartSLOduration=1.7319722629999998 podStartE2EDuration="4.489067929s" totalImagesPullingTime="2.757095666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:41:56.486738086 +0000 UTC m=+371.050493387" watchObservedRunningTime="2026-07-01 22:41:56.489067929 +0000 UTC m=+371.052823227" Jul 01 22:41:58.194532 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.194497 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln"] Jul 01 22:41:58.196529 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.196504 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:58.198165 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.198148 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.201088 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.201067 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 01 22:41:58.201672 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.201654 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 01 22:41:58.201785 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.201701 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v42kk\"" Jul 01 22:41:58.211070 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.211042 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln"] Jul 01 22:41:58.381589 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.381551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcp4k\" (UniqueName: \"kubernetes.io/projected/63c82215-b8d7-49cc-a26e-9e4177afec25-kube-api-access-vcp4k\") pod \"kuadrant-console-plugin-66b5774985-vtzln\" (UID: \"63c82215-b8d7-49cc-a26e-9e4177afec25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.381589 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.381594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/63c82215-b8d7-49cc-a26e-9e4177afec25-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vtzln\" (UID: \"63c82215-b8d7-49cc-a26e-9e4177afec25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.381831 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.381619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63c82215-b8d7-49cc-a26e-9e4177afec25-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vtzln\" (UID: \"63c82215-b8d7-49cc-a26e-9e4177afec25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.400029 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.400001 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:58.482933 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.482908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcp4k\" (UniqueName: \"kubernetes.io/projected/63c82215-b8d7-49cc-a26e-9e4177afec25-kube-api-access-vcp4k\") pod \"kuadrant-console-plugin-66b5774985-vtzln\" (UID: \"63c82215-b8d7-49cc-a26e-9e4177afec25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.483104 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.482943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/63c82215-b8d7-49cc-a26e-9e4177afec25-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vtzln\" (UID: \"63c82215-b8d7-49cc-a26e-9e4177afec25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.483104 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.482965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63c82215-b8d7-49cc-a26e-9e4177afec25-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vtzln\" (UID: \"63c82215-b8d7-49cc-a26e-9e4177afec25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.483553 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.483533 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63c82215-b8d7-49cc-a26e-9e4177afec25-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vtzln\" (UID: \"63c82215-b8d7-49cc-a26e-9e4177afec25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.485366 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.485346 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/63c82215-b8d7-49cc-a26e-9e4177afec25-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vtzln\" (UID: \"63c82215-b8d7-49cc-a26e-9e4177afec25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.494320 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.494300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcp4k\" (UniqueName: \"kubernetes.io/projected/63c82215-b8d7-49cc-a26e-9e4177afec25-kube-api-access-vcp4k\") pod \"kuadrant-console-plugin-66b5774985-vtzln\" (UID: \"63c82215-b8d7-49cc-a26e-9e4177afec25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.507178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.507156 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" Jul 01 22:41:58.650319 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.650293 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln"] Jul 01 22:41:58.652084 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:41:58.652054 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63c82215_b8d7_49cc_a26e_9e4177afec25.slice/crio-24c2eca07c00742bae80203313c9bf9efe53d755ae934f930456527369e70a2c WatchSource:0}: Error finding container 24c2eca07c00742bae80203313c9bf9efe53d755ae934f930456527369e70a2c: Status 404 returned error can't find the container with id 24c2eca07c00742bae80203313c9bf9efe53d755ae934f930456527369e70a2c Jul 01 22:41:58.699921 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.699891 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:58.836087 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:58.836007 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:41:59.468061 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:41:59.468023 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" event={"ID":"63c82215-b8d7-49cc-a26e-9e4177afec25","Type":"ContainerStarted","Data":"24c2eca07c00742bae80203313c9bf9efe53d755ae934f930456527369e70a2c"} Jul 01 22:42:00.770088 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:00.770056 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:00.837692 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:00.837651 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:07.456574 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:07.456536 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:07.457171 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:07.456648 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:08.355246 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:08.355203 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:08.602459 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:08.602423 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:09.332532 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.332496 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx"] Jul 01 22:42:09.332770 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.332743 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" containerName="manager" containerID="cri-o://f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc" gracePeriod=2 Jul 01 22:42:09.350643 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.350613 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx"] Jul 01 22:42:09.356674 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:09.356627 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\": pods \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:09.364688 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.364658 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9"] Jul 01 22:42:09.365315 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.365293 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" containerName="manager" Jul 01 22:42:09.365315 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.365316 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" containerName="manager" Jul 01 22:42:09.365537 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.365411 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" containerName="manager" Jul 01 22:42:09.368755 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.368734 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d"] Jul 01 22:42:09.368975 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.368955 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:09.369089 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.368953 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" containerName="manager" containerID="cri-o://3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c" gracePeriod=2 Jul 01 22:42:09.386366 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:09.384570 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:09.387450 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:09.387412 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:09.388359 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.388335 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d"] Jul 01 22:42:09.389232 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:09.389198 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:09.391347 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:09.391313 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:09.391584 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.391557 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9"] Jul 01 22:42:09.410762 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.410736 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25"] Jul 01 22:42:09.411255 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.411234 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" containerName="manager" Jul 01 22:42:09.411255 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.411256 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" containerName="manager" Jul 01 22:42:09.411421 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.411348 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" containerName="manager" Jul 01 22:42:09.414691 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.414658 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" Jul 01 22:42:09.419678 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:09.419648 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:09.423296 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:09.423264 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:09.435877 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.435853 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25"] Jul 01 22:42:09.484564 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.484541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v888\" (UniqueName: \"kubernetes.io/projected/a1064654-c866-4b45-b3fd-08b78b81b8d8-kube-api-access-7v888\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxhl9\" (UID: \"a1064654-c866-4b45-b3fd-08b78b81b8d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:09.484711 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.484583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqp8b\" (UniqueName: \"kubernetes.io/projected/fd47e61a-f7ca-4afe-aba3-65ce9d465575-kube-api-access-dqp8b\") pod \"limitador-operator-controller-manager-859d7b78bd-j6j25\" (UID: \"fd47e61a-f7ca-4afe-aba3-65ce9d465575\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" Jul 01 22:42:09.484828 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.484786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1064654-c866-4b45-b3fd-08b78b81b8d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxhl9\" (UID: \"a1064654-c866-4b45-b3fd-08b78b81b8d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:09.585708 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.585613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1064654-c866-4b45-b3fd-08b78b81b8d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxhl9\" (UID: \"a1064654-c866-4b45-b3fd-08b78b81b8d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:09.585708 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.585694 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v888\" (UniqueName: \"kubernetes.io/projected/a1064654-c866-4b45-b3fd-08b78b81b8d8-kube-api-access-7v888\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxhl9\" (UID: \"a1064654-c866-4b45-b3fd-08b78b81b8d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:09.585946 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.585730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqp8b\" (UniqueName: \"kubernetes.io/projected/fd47e61a-f7ca-4afe-aba3-65ce9d465575-kube-api-access-dqp8b\") pod \"limitador-operator-controller-manager-859d7b78bd-j6j25\" (UID: \"fd47e61a-f7ca-4afe-aba3-65ce9d465575\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" Jul 01 22:42:09.586291 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.586040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1064654-c866-4b45-b3fd-08b78b81b8d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxhl9\" (UID: \"a1064654-c866-4b45-b3fd-08b78b81b8d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:09.600961 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.600933 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqp8b\" (UniqueName: \"kubernetes.io/projected/fd47e61a-f7ca-4afe-aba3-65ce9d465575-kube-api-access-dqp8b\") pod \"limitador-operator-controller-manager-859d7b78bd-j6j25\" (UID: \"fd47e61a-f7ca-4afe-aba3-65ce9d465575\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" Jul 01 22:42:09.601102 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.601036 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v888\" (UniqueName: \"kubernetes.io/projected/a1064654-c866-4b45-b3fd-08b78b81b8d8-kube-api-access-7v888\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lxhl9\" (UID: \"a1064654-c866-4b45-b3fd-08b78b81b8d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:09.755180 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.755144 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:09.762334 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:09.762304 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" Jul 01 22:42:10.836269 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:10.836234 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:11.028641 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:11.028602 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:17.225042 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:17.224999 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:17.322430 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:17.322393 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:19.538242 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:19.538203 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:19.684255 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:19.684213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:20.915120 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.915094 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:20.917441 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:20.917396 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:20.922147 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.922121 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25"] Jul 01 22:42:20.923462 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.923443 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:20.924014 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:42:20.923991 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd47e61a_f7ca_4afe_aba3_65ce9d465575.slice/crio-fee96803401afccd7891faa142e21e5af818b369c21ce19d1ceba45d6e7bca59 WatchSource:0}: Error finding container fee96803401afccd7891faa142e21e5af818b369c21ce19d1ceba45d6e7bca59: Status 404 returned error can't find the container with id fee96803401afccd7891faa142e21e5af818b369c21ce19d1ceba45d6e7bca59 Jul 01 22:42:20.925608 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:20.925579 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:20.927389 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:20.927355 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:20.950556 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.950533 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9"] Jul 01 22:42:20.960102 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:42:20.960074 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1064654_c866_4b45_b3fd_08b78b81b8d8.slice/crio-c9091453474b85841a3677e498b12e1b872439a1dcab15fa1d265a120948046f WatchSource:0}: Error finding container c9091453474b85841a3677e498b12e1b872439a1dcab15fa1d265a120948046f: Status 404 returned error can't find the container with id c9091453474b85841a3677e498b12e1b872439a1dcab15fa1d265a120948046f Jul 01 22:42:20.992099 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.992073 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-extensions-socket-volume\") pod \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\" (UID: \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\") " Jul 01 22:42:20.992218 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.992176 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws7l9\" (UniqueName: \"kubernetes.io/projected/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-kube-api-access-ws7l9\") pod \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\" (UID: \"cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94\") " Jul 01 22:42:20.992279 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.992237 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m54f\" (UniqueName: \"kubernetes.io/projected/75680bc0-a155-4c32-afbc-503e105a0d81-kube-api-access-8m54f\") pod \"75680bc0-a155-4c32-afbc-503e105a0d81\" (UID: \"75680bc0-a155-4c32-afbc-503e105a0d81\") " Jul 01 22:42:20.992575 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.992549 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" (UID: "cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:42:20.994304 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.994275 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75680bc0-a155-4c32-afbc-503e105a0d81-kube-api-access-8m54f" (OuterVolumeSpecName: "kube-api-access-8m54f") pod "75680bc0-a155-4c32-afbc-503e105a0d81" (UID: "75680bc0-a155-4c32-afbc-503e105a0d81"). InnerVolumeSpecName "kube-api-access-8m54f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:42:20.994416 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:20.994391 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-kube-api-access-ws7l9" (OuterVolumeSpecName: "kube-api-access-ws7l9") pod "cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" (UID: "cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94"). InnerVolumeSpecName "kube-api-access-ws7l9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:42:21.093584 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.093551 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m54f\" (UniqueName: \"kubernetes.io/projected/75680bc0-a155-4c32-afbc-503e105a0d81-kube-api-access-8m54f\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:42:21.093584 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.093580 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-extensions-socket-volume\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:42:21.093584 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.093590 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws7l9\" (UniqueName: \"kubernetes.io/projected/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94-kube-api-access-ws7l9\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:42:21.204251 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.204202 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:21.304297 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.304206 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:21.604576 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.604497 2561 generic.go:356] "Generic (PLEG): container finished" podID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" containerID="f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc" exitCode=0 Jul 01 22:42:21.604576 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.604542 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:21.604776 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.604597 2561 scope.go:117] "RemoveContainer" containerID="f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc" Jul 01 22:42:21.606186 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.606160 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" event={"ID":"63c82215-b8d7-49cc-a26e-9e4177afec25","Type":"ContainerStarted","Data":"d52b78de7dd6a14afe3bbd7df90b9a2cce9fc3f58ea227a883d947918032f664"} Jul 01 22:42:21.607319 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:21.607293 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:21.607958 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.607939 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" event={"ID":"a1064654-c866-4b45-b3fd-08b78b81b8d8","Type":"ContainerStarted","Data":"4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822"} Jul 01 22:42:21.608055 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.607984 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:21.608055 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.608004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" event={"ID":"a1064654-c866-4b45-b3fd-08b78b81b8d8","Type":"ContainerStarted","Data":"c9091453474b85841a3677e498b12e1b872439a1dcab15fa1d265a120948046f"} Jul 01 22:42:21.609390 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:21.609365 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:21.610222 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.610074 2561 generic.go:356] "Generic (PLEG): container finished" podID="75680bc0-a155-4c32-afbc-503e105a0d81" containerID="3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c" exitCode=0 Jul 01 22:42:21.610222 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.610125 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:21.612605 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:21.612551 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:21.613255 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.613228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" event={"ID":"fd47e61a-f7ca-4afe-aba3-65ce9d465575","Type":"ContainerStarted","Data":"81f8f03c20c9770c13a85895ffb095b0e12fcc5077c3329153206409464a57f3"} Jul 01 22:42:21.613365 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.613274 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" event={"ID":"fd47e61a-f7ca-4afe-aba3-65ce9d465575","Type":"ContainerStarted","Data":"fee96803401afccd7891faa142e21e5af818b369c21ce19d1ceba45d6e7bca59"} Jul 01 22:42:21.613365 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.613305 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" Jul 01 22:42:21.616778 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.616759 2561 scope.go:117] "RemoveContainer" containerID="f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc" Jul 01 22:42:21.617089 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:21.617071 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc\": container with ID starting with f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc not found: ID does not exist" containerID="f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc" Jul 01 22:42:21.617178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.617094 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc"} err="failed to get container status \"f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc\": rpc error: code = NotFound desc = could not find container \"f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc\": container with ID starting with f20091566586e0a733556382cf19accdfdf924a9c45b15c044fadbcbeac18cfc not found: ID does not exist" Jul 01 22:42:21.617178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.617112 2561 scope.go:117] "RemoveContainer" containerID="3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c" Jul 01 22:42:21.625256 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.625235 2561 scope.go:117] "RemoveContainer" containerID="3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c" Jul 01 22:42:21.625558 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:21.625541 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c\": container with ID starting with 3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c not found: ID does not exist" containerID="3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c" Jul 01 22:42:21.625608 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.625566 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c"} err="failed to get container status \"3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c\": rpc error: code = NotFound desc = could not find container \"3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c\": container with ID starting with 3bb77174fdce050900d3ebb749617aa7ac179577851927274058a03e9cdb904c not found: ID does not exist" Jul 01 22:42:21.637891 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.637849 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vtzln" podStartSLOduration=1.454925091 podStartE2EDuration="23.637836008s" totalImagesPullingTime="22.182910917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:42:21.635416608 +0000 UTC m=+396.199171906" watchObservedRunningTime="2026-07-01 22:42:21.637836008 +0000 UTC m=+396.201591308" Jul 01 22:42:21.669084 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:21.669035 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:21.669868 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.669821 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" podStartSLOduration=12.669775774 podStartE2EDuration="12.669775774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:42:21.666188449 +0000 UTC m=+396.229943761" watchObservedRunningTime="2026-07-01 22:42:21.669775774 +0000 UTC m=+396.233531074" Jul 01 22:42:21.670894 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:21.670868 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tt6bx\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tt6bx" Jul 01 22:42:21.672646 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:21.672623 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cn6d\" is forbidden: User \"system:node:ip-10-0-128-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-139.ec2.internal' and this object" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cn6d" Jul 01 22:42:21.693747 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.693701 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" podStartSLOduration=12.693688422 podStartE2EDuration="12.693688422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:42:21.691015326 +0000 UTC m=+396.254770625" watchObservedRunningTime="2026-07-01 22:42:21.693688422 +0000 UTC m=+396.257443720" Jul 01 22:42:21.871954 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.871847 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75680bc0-a155-4c32-afbc-503e105a0d81" path="/var/lib/kubelet/pods/75680bc0-a155-4c32-afbc-503e105a0d81/volumes" Jul 01 22:42:21.872333 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:21.872314 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94" path="/var/lib/kubelet/pods/cfbc169b-1cba-4f1c-ab4e-b1f0fcd25d94/volumes" Jul 01 22:42:26.271350 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.271317 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9"] Jul 01 22:42:26.271714 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.271480 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" podUID="a1064654-c866-4b45-b3fd-08b78b81b8d8" containerName="manager" containerID="cri-o://4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822" gracePeriod=10 Jul 01 22:42:26.273139 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.273117 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:26.529522 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.529495 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:26.640457 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.640358 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1064654-c866-4b45-b3fd-08b78b81b8d8-extensions-socket-volume\") pod \"a1064654-c866-4b45-b3fd-08b78b81b8d8\" (UID: \"a1064654-c866-4b45-b3fd-08b78b81b8d8\") " Jul 01 22:42:26.640457 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.640418 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v888\" (UniqueName: \"kubernetes.io/projected/a1064654-c866-4b45-b3fd-08b78b81b8d8-kube-api-access-7v888\") pod \"a1064654-c866-4b45-b3fd-08b78b81b8d8\" (UID: \"a1064654-c866-4b45-b3fd-08b78b81b8d8\") " Jul 01 22:42:26.640835 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.640779 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1064654-c866-4b45-b3fd-08b78b81b8d8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a1064654-c866-4b45-b3fd-08b78b81b8d8" (UID: "a1064654-c866-4b45-b3fd-08b78b81b8d8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:42:26.642571 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.642546 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1064654-c866-4b45-b3fd-08b78b81b8d8-kube-api-access-7v888" (OuterVolumeSpecName: "kube-api-access-7v888") pod "a1064654-c866-4b45-b3fd-08b78b81b8d8" (UID: "a1064654-c866-4b45-b3fd-08b78b81b8d8"). InnerVolumeSpecName "kube-api-access-7v888". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:42:26.646859 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.646834 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1064654-c866-4b45-b3fd-08b78b81b8d8" containerID="4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822" exitCode=0 Jul 01 22:42:26.646957 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.646899 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" event={"ID":"a1064654-c866-4b45-b3fd-08b78b81b8d8","Type":"ContainerDied","Data":"4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822"} Jul 01 22:42:26.646957 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.646902 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" Jul 01 22:42:26.646957 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.646941 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9" event={"ID":"a1064654-c866-4b45-b3fd-08b78b81b8d8","Type":"ContainerDied","Data":"c9091453474b85841a3677e498b12e1b872439a1dcab15fa1d265a120948046f"} Jul 01 22:42:26.647112 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.646963 2561 scope.go:117] "RemoveContainer" containerID="4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822" Jul 01 22:42:26.655976 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.655959 2561 scope.go:117] "RemoveContainer" containerID="4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822" Jul 01 22:42:26.656243 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:42:26.656226 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822\": container with ID starting with 4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822 not found: ID does not exist" containerID="4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822" Jul 01 22:42:26.656294 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.656252 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822"} err="failed to get container status \"4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822\": rpc error: code = NotFound desc = could not find container \"4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822\": container with ID starting with 4f85acca3947e747a1dadc939f01438e445e0eaaf93ac182139d2fa145b4c822 not found: ID does not exist" Jul 01 22:42:26.671500 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.671475 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9"] Jul 01 22:42:26.685198 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.685171 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lxhl9"] Jul 01 22:42:26.742018 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.741985 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1064654-c866-4b45-b3fd-08b78b81b8d8-extensions-socket-volume\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:42:26.742018 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:26.742012 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v888\" (UniqueName: \"kubernetes.io/projected/a1064654-c866-4b45-b3fd-08b78b81b8d8-kube-api-access-7v888\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:42:27.872504 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:27.872468 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1064654-c866-4b45-b3fd-08b78b81b8d8" path="/var/lib/kubelet/pods/a1064654-c866-4b45-b3fd-08b78b81b8d8/volumes" Jul 01 22:42:28.994637 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:28.994565 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:29.120038 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:29.120010 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:32.590730 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:32.590699 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:32.622253 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:32.622223 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6j25" Jul 01 22:42:32.693211 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:32.693184 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:34.122388 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.122347 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77fcd9d55f-l5k54"] Jul 01 22:42:34.123266 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.123241 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1064654-c866-4b45-b3fd-08b78b81b8d8" containerName="manager" Jul 01 22:42:34.123266 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.123268 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1064654-c866-4b45-b3fd-08b78b81b8d8" containerName="manager" Jul 01 22:42:34.123427 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.123355 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1064654-c866-4b45-b3fd-08b78b81b8d8" containerName="manager" Jul 01 22:42:34.127415 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.127390 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.137747 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.137694 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77fcd9d55f-l5k54"] Jul 01 22:42:34.186911 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.186886 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:34.203888 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.203867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e531bb70-8499-429a-b111-57978746cd91-console-oauth-config\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.203979 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.203892 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-service-ca\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.203979 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.203920 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-oauth-serving-cert\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.204054 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.203997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-console-config\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.204054 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.204023 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-trusted-ca-bundle\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.204117 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.204098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e531bb70-8499-429a-b111-57978746cd91-console-serving-cert\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.204154 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.204128 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xprnr\" (UniqueName: \"kubernetes.io/projected/e531bb70-8499-429a-b111-57978746cd91-kube-api-access-xprnr\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.255449 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.255425 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:34.304860 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.304834 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-oauth-serving-cert\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.304950 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.304877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-console-config\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.304950 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.304896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-trusted-ca-bundle\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.304950 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.304934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e531bb70-8499-429a-b111-57978746cd91-console-serving-cert\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.305079 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.304957 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xprnr\" (UniqueName: \"kubernetes.io/projected/e531bb70-8499-429a-b111-57978746cd91-kube-api-access-xprnr\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.305079 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.305022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e531bb70-8499-429a-b111-57978746cd91-console-oauth-config\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.305079 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.305046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-service-ca\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.305690 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.305664 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-oauth-serving-cert\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.305818 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.305692 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-console-config\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.305902 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.305814 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-service-ca\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.305902 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.305830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e531bb70-8499-429a-b111-57978746cd91-trusted-ca-bundle\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.307435 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.307405 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e531bb70-8499-429a-b111-57978746cd91-console-serving-cert\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.307569 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.307548 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e531bb70-8499-429a-b111-57978746cd91-console-oauth-config\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.313225 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.313203 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xprnr\" (UniqueName: \"kubernetes.io/projected/e531bb70-8499-429a-b111-57978746cd91-kube-api-access-xprnr\") pod \"console-77fcd9d55f-l5k54\" (UID: \"e531bb70-8499-429a-b111-57978746cd91\") " pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.438011 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.437923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:34.577432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.577408 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77fcd9d55f-l5k54"] Jul 01 22:42:34.578788 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:42:34.578758 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode531bb70_8499_429a_b111_57978746cd91.slice/crio-114fe7d842af86545f232182e471e8fca0fa22f4093932ceccc146a6a2795d0a WatchSource:0}: Error finding container 114fe7d842af86545f232182e471e8fca0fa22f4093932ceccc146a6a2795d0a: Status 404 returned error can't find the container with id 114fe7d842af86545f232182e471e8fca0fa22f4093932ceccc146a6a2795d0a Jul 01 22:42:34.692179 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.692088 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77fcd9d55f-l5k54" event={"ID":"e531bb70-8499-429a-b111-57978746cd91","Type":"ContainerStarted","Data":"10ecaf884337bab4beefa57ae417490f9fea18dcfacf30c39dc75e53c6f447f0"} Jul 01 22:42:34.692179 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.692147 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77fcd9d55f-l5k54" event={"ID":"e531bb70-8499-429a-b111-57978746cd91","Type":"ContainerStarted","Data":"114fe7d842af86545f232182e471e8fca0fa22f4093932ceccc146a6a2795d0a"} Jul 01 22:42:34.713538 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:34.713488 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77fcd9d55f-l5k54" podStartSLOduration=0.713470267 podStartE2EDuration="713.470267ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:42:34.711657708 +0000 UTC m=+409.275413007" watchObservedRunningTime="2026-07-01 22:42:34.713470267 +0000 UTC m=+409.277225567" Jul 01 22:42:37.614120 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:37.614086 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:37.746624 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:37.746592 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:42.601820 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.601766 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7"] Jul 01 22:42:42.630434 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.630390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:42.654051 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.654023 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7"] Jul 01 22:42:42.654182 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.654117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.657357 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.657337 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6sfjr\"" Jul 01 22:42:42.778864 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.778834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79a70606-00ab-4054-9680-c302681ede30-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.779030 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.778877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-credential-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.779030 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.778906 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-istio-data\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.779030 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.778946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79a70606-00ab-4054-9680-c302681ede30-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.779030 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.779020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qc2p\" (UniqueName: \"kubernetes.io/projected/79a70606-00ab-4054-9680-c302681ede30-kube-api-access-6qc2p\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.779175 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.779068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-workload-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.779175 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.779089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-workload-certs\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.779175 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.779108 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79a70606-00ab-4054-9680-c302681ede30-istio-token\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.779175 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.779133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-istio-envoy\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880216 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79a70606-00ab-4054-9680-c302681ede30-istio-token\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880216 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-istio-envoy\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880216 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79a70606-00ab-4054-9680-c302681ede30-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880476 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-credential-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880476 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-istio-data\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880476 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79a70606-00ab-4054-9680-c302681ede30-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880476 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880314 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qc2p\" (UniqueName: \"kubernetes.io/projected/79a70606-00ab-4054-9680-c302681ede30-kube-api-access-6qc2p\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880476 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-workload-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880476 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-workload-certs\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880772 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880706 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-credential-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880772 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-istio-data\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880911 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-workload-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.880911 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.880885 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-workload-certs\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.881178 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.881159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79a70606-00ab-4054-9680-c302681ede30-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.882676 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.882660 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79a70606-00ab-4054-9680-c302681ede30-istio-envoy\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.882744 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.882730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79a70606-00ab-4054-9680-c302681ede30-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.889582 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.889558 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qc2p\" (UniqueName: \"kubernetes.io/projected/79a70606-00ab-4054-9680-c302681ede30-kube-api-access-6qc2p\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.890041 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.890021 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79a70606-00ab-4054-9680-c302681ede30-istio-token\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-qdcq7\" (UID: \"79a70606-00ab-4054-9680-c302681ede30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:42.964783 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:42.964753 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:43.152271 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:43.152249 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7"] Jul 01 22:42:43.154217 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:42:43.154190 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a70606_00ab_4054_9680_c302681ede30.slice/crio-8261c9a83e5a376a1ca355c6bc3c8b7f134011f6de0e02e4832e8cab6a048190 WatchSource:0}: Error finding container 8261c9a83e5a376a1ca355c6bc3c8b7f134011f6de0e02e4832e8cab6a048190: Status 404 returned error can't find the container with id 8261c9a83e5a376a1ca355c6bc3c8b7f134011f6de0e02e4832e8cab6a048190 Jul 01 22:42:43.156387 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:43.156353 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 22:42:43.156464 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:43.156417 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 22:42:43.156464 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:43.156448 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 22:42:43.177810 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:43.177768 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:43.742424 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:43.742388 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" event={"ID":"79a70606-00ab-4054-9680-c302681ede30","Type":"ContainerStarted","Data":"9caed4f66077d7505a3d378efaab587ae55bf7c1ba38e80a216b38401a3b03c2"} Jul 01 22:42:43.742848 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:43.742443 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" event={"ID":"79a70606-00ab-4054-9680-c302681ede30","Type":"ContainerStarted","Data":"8261c9a83e5a376a1ca355c6bc3c8b7f134011f6de0e02e4832e8cab6a048190"} Jul 01 22:42:43.764772 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:43.764729 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" podStartSLOduration=1.764715883 podStartE2EDuration="1.764715883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:42:43.763072979 +0000 UTC m=+418.326828283" watchObservedRunningTime="2026-07-01 22:42:43.764715883 +0000 UTC m=+418.328471210" Jul 01 22:42:43.964980 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:43.964947 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:44.438730 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:44.438688 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:44.438968 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:44.438752 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:44.443708 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:44.443687 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:44.751695 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:44.751665 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77fcd9d55f-l5k54" Jul 01 22:42:44.806621 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:44.806590 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbd66cfd7-qpcv5"] Jul 01 22:42:44.864242 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:44.864213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:44.967587 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:44.967558 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:44.970369 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:44.970343 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:45.050864 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.050760 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:45.136690 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.136655 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:45.210307 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.210274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:45.284981 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.284948 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:42:45.419933 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.419847 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:42:45.419933 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.419893 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:42:45.420158 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.419964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:42:45.423159 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.423135 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 22:42:45.606367 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.606304 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsrh\" (UniqueName: \"kubernetes.io/projected/2c8b49c9-e13d-4c1d-be74-a90f775f3133-kube-api-access-lwsrh\") pod \"limitador-limitador-54d6d988d5-thtfc\" (UID: \"2c8b49c9-e13d-4c1d-be74-a90f775f3133\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:42:45.606525 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.606495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c8b49c9-e13d-4c1d-be74-a90f775f3133-config-file\") pod \"limitador-limitador-54d6d988d5-thtfc\" (UID: \"2c8b49c9-e13d-4c1d-be74-a90f775f3133\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:42:45.707264 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.707234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c8b49c9-e13d-4c1d-be74-a90f775f3133-config-file\") pod \"limitador-limitador-54d6d988d5-thtfc\" (UID: \"2c8b49c9-e13d-4c1d-be74-a90f775f3133\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:42:45.707457 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.707293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsrh\" (UniqueName: \"kubernetes.io/projected/2c8b49c9-e13d-4c1d-be74-a90f775f3133-kube-api-access-lwsrh\") pod \"limitador-limitador-54d6d988d5-thtfc\" (UID: \"2c8b49c9-e13d-4c1d-be74-a90f775f3133\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:42:45.707948 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.707924 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c8b49c9-e13d-4c1d-be74-a90f775f3133-config-file\") pod \"limitador-limitador-54d6d988d5-thtfc\" (UID: \"2c8b49c9-e13d-4c1d-be74-a90f775f3133\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:42:45.730904 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.730878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsrh\" (UniqueName: \"kubernetes.io/projected/2c8b49c9-e13d-4c1d-be74-a90f775f3133-kube-api-access-lwsrh\") pod \"limitador-limitador-54d6d988d5-thtfc\" (UID: \"2c8b49c9-e13d-4c1d-be74-a90f775f3133\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:42:45.754242 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.754212 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:45.755370 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.755348 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:42:45.964843 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:45.964741 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:46.031032 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:46.030986 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:42:46.043682 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:46.043643 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:42:46.241336 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:46.241308 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:42:46.243007 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:42:46.242971 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8b49c9_e13d_4c1d_be74_a90f775f3133.slice/crio-bf7efa5941601dae3eb8eebabe3a07195885c81b2aa7989e399dd1062aeb59d3 WatchSource:0}: Error finding container bf7efa5941601dae3eb8eebabe3a07195885c81b2aa7989e399dd1062aeb59d3: Status 404 returned error can't find the container with id bf7efa5941601dae3eb8eebabe3a07195885c81b2aa7989e399dd1062aeb59d3 Jul 01 22:42:46.760610 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:46.760573 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" event={"ID":"2c8b49c9-e13d-4c1d-be74-a90f775f3133","Type":"ContainerStarted","Data":"bf7efa5941601dae3eb8eebabe3a07195885c81b2aa7989e399dd1062aeb59d3"} Jul 01 22:42:50.789221 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:50.789185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" event={"ID":"2c8b49c9-e13d-4c1d-be74-a90f775f3133","Type":"ContainerStarted","Data":"e3c3ae3c93109cedad1a8de837ca164fdeed1d69e38b0222e97ba73cc47bc48e"} Jul 01 22:42:50.789726 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:50.789254 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:42:50.810527 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:42:50.810474 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" podStartSLOduration=1.693846539 podStartE2EDuration="5.810457379s" totalImagesPullingTime="4.11661084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:42:50.809189 +0000 UTC m=+425.372944299" watchObservedRunningTime="2026-07-01 22:42:50.810457379 +0000 UTC m=+425.374212678" Jul 01 22:43:01.795693 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:01.795663 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-thtfc" Jul 01 22:43:06.377692 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:06.377653 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:43:09.828398 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:09.828288 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fbd66cfd7-qpcv5" podUID="77a4a277-dab1-4b4c-b5e4-6327aefdc76f" containerName="console" containerID="cri-o://4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03" gracePeriod=15 Jul 01 22:43:10.072109 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.072085 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:43:10.119564 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.119484 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-oauth-serving-cert\") pod \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " Jul 01 22:43:10.119752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.119732 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-trusted-ca-bundle\") pod \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " Jul 01 22:43:10.119860 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.119786 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-service-ca\") pod \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " Jul 01 22:43:10.119860 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.119845 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-serving-cert\") pod \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " Jul 01 22:43:10.119976 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.119878 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxnpv\" (UniqueName: \"kubernetes.io/projected/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-kube-api-access-pxnpv\") pod \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " Jul 01 22:43:10.119976 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.119900 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-config\") pod \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " Jul 01 22:43:10.119976 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.119921 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-oauth-config\") pod \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\" (UID: \"77a4a277-dab1-4b4c-b5e4-6327aefdc76f\") " Jul 01 22:43:10.120128 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.120029 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "77a4a277-dab1-4b4c-b5e4-6327aefdc76f" (UID: "77a4a277-dab1-4b4c-b5e4-6327aefdc76f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:43:10.120233 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.120208 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-oauth-serving-cert\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:10.120418 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.120395 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-service-ca" (OuterVolumeSpecName: "service-ca") pod "77a4a277-dab1-4b4c-b5e4-6327aefdc76f" (UID: "77a4a277-dab1-4b4c-b5e4-6327aefdc76f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:43:10.120418 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.120404 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-config" (OuterVolumeSpecName: "console-config") pod "77a4a277-dab1-4b4c-b5e4-6327aefdc76f" (UID: "77a4a277-dab1-4b4c-b5e4-6327aefdc76f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:43:10.120610 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.120577 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "77a4a277-dab1-4b4c-b5e4-6327aefdc76f" (UID: "77a4a277-dab1-4b4c-b5e4-6327aefdc76f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:43:10.122142 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.122115 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "77a4a277-dab1-4b4c-b5e4-6327aefdc76f" (UID: "77a4a277-dab1-4b4c-b5e4-6327aefdc76f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:43:10.122237 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.122165 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "77a4a277-dab1-4b4c-b5e4-6327aefdc76f" (UID: "77a4a277-dab1-4b4c-b5e4-6327aefdc76f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:43:10.122421 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.122402 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-kube-api-access-pxnpv" (OuterVolumeSpecName: "kube-api-access-pxnpv") pod "77a4a277-dab1-4b4c-b5e4-6327aefdc76f" (UID: "77a4a277-dab1-4b4c-b5e4-6327aefdc76f"). InnerVolumeSpecName "kube-api-access-pxnpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:43:10.220607 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.220575 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-trusted-ca-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:10.220696 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.220608 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-service-ca\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:10.220696 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.220624 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-serving-cert\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:10.220696 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.220636 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxnpv\" (UniqueName: \"kubernetes.io/projected/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-kube-api-access-pxnpv\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:10.220696 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.220645 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-config\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:10.220696 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.220654 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a4a277-dab1-4b4c-b5e4-6327aefdc76f-console-oauth-config\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:10.898076 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.898044 2561 generic.go:356] "Generic (PLEG): container finished" podID="77a4a277-dab1-4b4c-b5e4-6327aefdc76f" containerID="4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03" exitCode=0 Jul 01 22:43:10.898451 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.898094 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbd66cfd7-qpcv5" Jul 01 22:43:10.898451 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.898123 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbd66cfd7-qpcv5" event={"ID":"77a4a277-dab1-4b4c-b5e4-6327aefdc76f","Type":"ContainerDied","Data":"4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03"} Jul 01 22:43:10.898451 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.898157 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbd66cfd7-qpcv5" event={"ID":"77a4a277-dab1-4b4c-b5e4-6327aefdc76f","Type":"ContainerDied","Data":"514e4ab74db55a33b2c3f509838ae1fc194eaa15a5bd993459b76170d5c903d5"} Jul 01 22:43:10.898451 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.898177 2561 scope.go:117] "RemoveContainer" containerID="4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03" Jul 01 22:43:10.908492 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.908472 2561 scope.go:117] "RemoveContainer" containerID="4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03" Jul 01 22:43:10.908746 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:43:10.908724 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03\": container with ID starting with 4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03 not found: ID does not exist" containerID="4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03" Jul 01 22:43:10.908814 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.908754 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03"} err="failed to get container status \"4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03\": rpc error: code = NotFound desc = could not find container \"4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03\": container with ID starting with 4a26c11996bb93c178f6e6e21cc1c839442ef6b7f6a68b64d156a0765f32ff03 not found: ID does not exist" Jul 01 22:43:10.924282 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.924260 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbd66cfd7-qpcv5"] Jul 01 22:43:10.929765 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:10.929745 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fbd66cfd7-qpcv5"] Jul 01 22:43:11.872432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:11.872398 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77a4a277-dab1-4b4c-b5e4-6327aefdc76f" path="/var/lib/kubelet/pods/77a4a277-dab1-4b4c-b5e4-6327aefdc76f/volumes" Jul 01 22:43:18.821841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:18.821783 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:43:18.922702 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:18.922669 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:43:19.037034 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:19.037001 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:43:27.769604 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.769568 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd"] Jul 01 22:43:27.770028 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.769932 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a4a277-dab1-4b4c-b5e4-6327aefdc76f" containerName="console" Jul 01 22:43:27.770028 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.769943 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a4a277-dab1-4b4c-b5e4-6327aefdc76f" containerName="console" Jul 01 22:43:27.770028 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.769995 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a4a277-dab1-4b4c-b5e4-6327aefdc76f" containerName="console" Jul 01 22:43:27.776057 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.776035 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:27.778626 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.778601 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 22:43:27.778744 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.778638 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xsk2h\"" Jul 01 22:43:27.778744 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.778607 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 22:43:27.784354 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.784328 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd"] Jul 01 22:43:27.796001 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.795980 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:43:27.862367 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.862333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:27.862514 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.862445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq2bc\" (UniqueName: \"kubernetes.io/projected/415c4f11-0f76-4d5b-be76-72fee9cffa16-kube-api-access-lq2bc\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:27.862514 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.862477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:27.963460 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.963431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq2bc\" (UniqueName: \"kubernetes.io/projected/415c4f11-0f76-4d5b-be76-72fee9cffa16-kube-api-access-lq2bc\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:27.963460 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.963463 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:27.963671 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.963491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:27.963818 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.963779 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:27.963895 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.963874 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:27.972647 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:27.972621 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq2bc\" (UniqueName: \"kubernetes.io/projected/415c4f11-0f76-4d5b-be76-72fee9cffa16-kube-api-access-lq2bc\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:28.085842 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:28.085756 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:28.424367 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:28.424343 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd"] Jul 01 22:43:28.426033 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:43:28.426007 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415c4f11_0f76_4d5b_be76_72fee9cffa16.slice/crio-c453b5dcf488995ceb14287d9717ebbf2ced0bbebcc21085032e14d8745060ae WatchSource:0}: Error finding container c453b5dcf488995ceb14287d9717ebbf2ced0bbebcc21085032e14d8745060ae: Status 404 returned error can't find the container with id c453b5dcf488995ceb14287d9717ebbf2ced0bbebcc21085032e14d8745060ae Jul 01 22:43:28.990590 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:28.990562 2561 generic.go:356] "Generic (PLEG): container finished" podID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerID="07502d8127171d40c2d2c2e7aa71d5954933d4381ce46b65d3506320ede5fd21" exitCode=0 Jul 01 22:43:28.990905 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:28.990652 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" event={"ID":"415c4f11-0f76-4d5b-be76-72fee9cffa16","Type":"ContainerDied","Data":"07502d8127171d40c2d2c2e7aa71d5954933d4381ce46b65d3506320ede5fd21"} Jul 01 22:43:28.990905 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:28.990714 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" event={"ID":"415c4f11-0f76-4d5b-be76-72fee9cffa16","Type":"ContainerStarted","Data":"c453b5dcf488995ceb14287d9717ebbf2ced0bbebcc21085032e14d8745060ae"} Jul 01 22:43:29.997065 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:29.997036 2561 generic.go:356] "Generic (PLEG): container finished" podID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerID="da0abcb0a4c91c55ef2d12678b0bfcff78e96bac494cf564b17bb62437328f16" exitCode=0 Jul 01 22:43:29.997405 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:29.997118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" event={"ID":"415c4f11-0f76-4d5b-be76-72fee9cffa16","Type":"ContainerDied","Data":"da0abcb0a4c91c55ef2d12678b0bfcff78e96bac494cf564b17bb62437328f16"} Jul 01 22:43:31.003626 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:31.003593 2561 generic.go:356] "Generic (PLEG): container finished" podID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerID="84a833b02e6856b8adb075930fbbc0b89d3110dddc28442259553c0c8eb76a0a" exitCode=0 Jul 01 22:43:31.004018 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:31.003676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" event={"ID":"415c4f11-0f76-4d5b-be76-72fee9cffa16","Type":"ContainerDied","Data":"84a833b02e6856b8adb075930fbbc0b89d3110dddc28442259553c0c8eb76a0a"} Jul 01 22:43:32.138288 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.138263 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:32.299350 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.299270 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-util\") pod \"415c4f11-0f76-4d5b-be76-72fee9cffa16\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " Jul 01 22:43:32.299494 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.299382 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-bundle\") pod \"415c4f11-0f76-4d5b-be76-72fee9cffa16\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " Jul 01 22:43:32.299494 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.299419 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq2bc\" (UniqueName: \"kubernetes.io/projected/415c4f11-0f76-4d5b-be76-72fee9cffa16-kube-api-access-lq2bc\") pod \"415c4f11-0f76-4d5b-be76-72fee9cffa16\" (UID: \"415c4f11-0f76-4d5b-be76-72fee9cffa16\") " Jul 01 22:43:32.299924 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.299890 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-bundle" (OuterVolumeSpecName: "bundle") pod "415c4f11-0f76-4d5b-be76-72fee9cffa16" (UID: "415c4f11-0f76-4d5b-be76-72fee9cffa16"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:43:32.301453 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.301426 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415c4f11-0f76-4d5b-be76-72fee9cffa16-kube-api-access-lq2bc" (OuterVolumeSpecName: "kube-api-access-lq2bc") pod "415c4f11-0f76-4d5b-be76-72fee9cffa16" (UID: "415c4f11-0f76-4d5b-be76-72fee9cffa16"). InnerVolumeSpecName "kube-api-access-lq2bc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:43:32.305686 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.305665 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-util" (OuterVolumeSpecName: "util") pod "415c4f11-0f76-4d5b-be76-72fee9cffa16" (UID: "415c4f11-0f76-4d5b-be76-72fee9cffa16"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:43:32.400979 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.400952 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-bundle\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:32.400979 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.400976 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq2bc\" (UniqueName: \"kubernetes.io/projected/415c4f11-0f76-4d5b-be76-72fee9cffa16-kube-api-access-lq2bc\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:32.401129 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:32.400987 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415c4f11-0f76-4d5b-be76-72fee9cffa16-util\") on node \"ip-10-0-128-139.ec2.internal\" DevicePath \"\"" Jul 01 22:43:33.016212 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:33.016176 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" event={"ID":"415c4f11-0f76-4d5b-be76-72fee9cffa16","Type":"ContainerDied","Data":"c453b5dcf488995ceb14287d9717ebbf2ced0bbebcc21085032e14d8745060ae"} Jul 01 22:43:33.016212 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:33.016221 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c453b5dcf488995ceb14287d9717ebbf2ced0bbebcc21085032e14d8745060ae" Jul 01 22:43:33.016474 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:33.016220 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8t2qrd" Jul 01 22:43:50.390044 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:50.390008 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:43:50.497723 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:50.497686 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:43:52.411932 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:52.411898 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:43:52.585935 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:43:52.585906 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:19.868047 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:19.867991 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:20.389549 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:20.389511 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:26.494565 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:26.494533 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:26.595268 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:26.595232 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:26.681208 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:26.681179 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:26.861273 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:26.861183 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:30.656200 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:30.656161 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:30.757654 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:30.757600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:31.747874 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:31.747835 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:39.092447 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:39.092319 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:47.924311 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:47.924280 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:44:47.990353 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:44:47.990305 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:03.172663 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:03.172593 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:03.725641 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:03.725597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:03.916903 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:03.916868 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:04.281541 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.281515 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:04.382278 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.382246 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:04.399730 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.399704 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-vd5b9"] Jul 01 22:45:04.400078 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.400065 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerName="extract" Jul 01 22:45:04.400128 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.400080 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerName="extract" Jul 01 22:45:04.400128 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.400092 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerName="util" Jul 01 22:45:04.400128 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.400098 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerName="util" Jul 01 22:45:04.400128 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.400109 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerName="pull" Jul 01 22:45:04.400128 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.400114 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerName="pull" Jul 01 22:45:04.400288 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.400172 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="415c4f11-0f76-4d5b-be76-72fee9cffa16" containerName="extract" Jul 01 22:45:04.403121 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.403106 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:04.405392 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.405373 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jrz98\"" Jul 01 22:45:04.405392 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.405377 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 22:45:04.414564 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.414541 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-vd5b9"] Jul 01 22:45:04.448237 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.448214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55a0c599-d4ab-4ff5-a4d9-2bb54881edf0-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-vd5b9\" (UID: \"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0\") " pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:04.448342 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.448317 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rssqh\" (UniqueName: \"kubernetes.io/projected/55a0c599-d4ab-4ff5-a4d9-2bb54881edf0-kube-api-access-rssqh\") pod \"payload-processing-7bbcb654f4-vd5b9\" (UID: \"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0\") " pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:04.517136 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.517114 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:45:04.549003 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.548947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55a0c599-d4ab-4ff5-a4d9-2bb54881edf0-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-vd5b9\" (UID: \"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0\") " pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:04.549091 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.549017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rssqh\" (UniqueName: \"kubernetes.io/projected/55a0c599-d4ab-4ff5-a4d9-2bb54881edf0-kube-api-access-rssqh\") pod \"payload-processing-7bbcb654f4-vd5b9\" (UID: \"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0\") " pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:04.549666 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.549650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55a0c599-d4ab-4ff5-a4d9-2bb54881edf0-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-vd5b9\" (UID: \"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0\") " pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:04.556514 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.556494 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rssqh\" (UniqueName: \"kubernetes.io/projected/55a0c599-d4ab-4ff5-a4d9-2bb54881edf0-kube-api-access-rssqh\") pod \"payload-processing-7bbcb654f4-vd5b9\" (UID: \"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0\") " pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:04.714606 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.714574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:04.846002 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:04.845974 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-vd5b9"] Jul 01 22:45:04.846916 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:45:04.846882 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a0c599_d4ab_4ff5_a4d9_2bb54881edf0.slice/crio-349d0d24ba0a072666ce0857946ca710494be7f0d7357cc9407b7184e3e72d0d WatchSource:0}: Error finding container 349d0d24ba0a072666ce0857946ca710494be7f0d7357cc9407b7184e3e72d0d: Status 404 returned error can't find the container with id 349d0d24ba0a072666ce0857946ca710494be7f0d7357cc9407b7184e3e72d0d Jul 01 22:45:05.527994 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:05.527916 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" event={"ID":"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0","Type":"ContainerStarted","Data":"349d0d24ba0a072666ce0857946ca710494be7f0d7357cc9407b7184e3e72d0d"} Jul 01 22:45:08.553556 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:08.553520 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" event={"ID":"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0","Type":"ContainerStarted","Data":"d04cdeec7cd315c9875529f0bf87dd565a5350577c2e80de748a1564c08f9335"} Jul 01 22:45:08.553981 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:08.553582 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:08.573080 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:08.573033 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" podStartSLOduration=1.568315089 podStartE2EDuration="4.573018648s" totalImagesPullingTime="3.004703559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:45:08.570446391 +0000 UTC m=+563.134201699" watchObservedRunningTime="2026-07-01 22:45:08.573018648 +0000 UTC m=+563.136773947" Jul 01 22:45:12.579243 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:12.579208 2561 generic.go:356] "Generic (PLEG): container finished" podID="79a70606-00ab-4054-9680-c302681ede30" containerID="9caed4f66077d7505a3d378efaab587ae55bf7c1ba38e80a216b38401a3b03c2" exitCode=0 Jul 01 22:45:12.579641 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:12.579292 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" event={"ID":"79a70606-00ab-4054-9680-c302681ede30","Type":"ContainerDied","Data":"9caed4f66077d7505a3d378efaab587ae55bf7c1ba38e80a216b38401a3b03c2"} Jul 01 22:45:12.579687 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:12.579652 2561 scope.go:117] "RemoveContainer" containerID="9caed4f66077d7505a3d378efaab587ae55bf7c1ba38e80a216b38401a3b03c2" Jul 01 22:45:12.580651 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:12.580605 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 22:45:12.580707 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:12.580694 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 22:45:12.580748 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:12.580737 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 22:45:13.587894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:13.587859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" event={"ID":"79a70606-00ab-4054-9680-c302681ede30","Type":"ContainerStarted","Data":"6239ee856da29239b5c6745390cc45a40daf7224b4b9002f84b8ef0fc327da2a"} Jul 01 22:45:13.965802 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:13.965762 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:45:13.967099 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:13.967075 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 01 22:45:13.967221 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:13.967121 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" podUID="79a70606-00ab-4054-9680-c302681ede30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 01 22:45:14.965465 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:14.965434 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 01 22:45:14.965857 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:14.965492 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" podUID="79a70606-00ab-4054-9680-c302681ede30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 01 22:45:15.754210 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:15.754174 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:45:15.965201 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:15.965168 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 01 22:45:15.965349 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:15.965231 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" podUID="79a70606-00ab-4054-9680-c302681ede30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 01 22:45:16.966090 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:16.966060 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 01 22:45:16.966520 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:16.966488 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" podUID="79a70606-00ab-4054-9680-c302681ede30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 01 22:45:17.968810 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:17.968771 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:45:17.969629 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:17.969608 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-qdcq7" Jul 01 22:45:19.562815 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:19.562765 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:45:29.146512 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:29.146478 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:29.214003 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:29.213969 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:33.406461 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:33.406426 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:45.856061 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:45.856027 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/2.log" Jul 01 22:45:45.856841 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:45.856822 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/2.log" Jul 01 22:45:45.862128 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:45.862110 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgww5_903919bd-c073-460c-b4d3-b0159dfc8e6e/ovn-acl-logging/0.log" Jul 01 22:45:45.862747 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:45.862729 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgww5_903919bd-c073-460c-b4d3-b0159dfc8e6e/ovn-acl-logging/0.log" Jul 01 22:45:53.388399 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:53.388365 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:45:53.486200 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:45:53.486160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:46:17.256695 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:17.256597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:46:17.438935 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:17.438906 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:46:22.098105 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.098065 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf"] Jul 01 22:46:22.101737 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.101715 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.104317 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.104295 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z2wgk\"" Jul 01 22:46:22.104406 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.104346 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 22:46:22.105338 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.105322 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 22:46:22.105451 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.105431 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 01 22:46:22.116877 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.116855 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf"] Jul 01 22:46:22.128188 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.128159 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:46:22.194801 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.194760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.194948 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.194827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.194948 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.194872 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vchk5\" (UniqueName: \"kubernetes.io/projected/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-kube-api-access-vchk5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.194948 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.194929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.195075 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.194967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.195075 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.194984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.295582 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.295542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.295582 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.295586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.295872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.295616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.295872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.295666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.295872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.295692 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vchk5\" (UniqueName: \"kubernetes.io/projected/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-kube-api-access-vchk5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.295872 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.295758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.296135 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.296111 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.296195 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.296139 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.296195 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.296155 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.297879 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.297858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.298298 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.298275 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.303879 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.303863 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vchk5\" (UniqueName: \"kubernetes.io/projected/4828cd50-1ac0-4715-b1f9-3ef37f78eaa5-kube-api-access-vchk5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c5gtf\" (UID: \"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.412734 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.412671 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:22.545709 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.545685 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf"] Jul 01 22:46:22.547749 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:46:22.547719 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4828cd50_1ac0_4715_b1f9_3ef37f78eaa5.slice/crio-39ce60d7c71d8041cc829fc8e6fbdc58e179eb946918e1ee6f9893718c016fd9 WatchSource:0}: Error finding container 39ce60d7c71d8041cc829fc8e6fbdc58e179eb946918e1ee6f9893718c016fd9: Status 404 returned error can't find the container with id 39ce60d7c71d8041cc829fc8e6fbdc58e179eb946918e1ee6f9893718c016fd9 Jul 01 22:46:22.549211 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.549191 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:46:22.884373 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.884341 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:46:22.968833 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:22.968778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" event={"ID":"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5","Type":"ContainerStarted","Data":"39ce60d7c71d8041cc829fc8e6fbdc58e179eb946918e1ee6f9893718c016fd9"} Jul 01 22:46:23.975615 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:23.975583 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" event={"ID":"4828cd50-1ac0-4715-b1f9-3ef37f78eaa5","Type":"ContainerStarted","Data":"485f94ddab53dc9db4dcbe938af6097600d83d49966655c9d72428bd92e2d2f5"} Jul 01 22:46:23.994120 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:23.994074 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" podStartSLOduration=1.004458405 podStartE2EDuration="1.99405922s" totalImagesPullingTime="989.600815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:46:23.992382535 +0000 UTC m=+638.556137846" watchObservedRunningTime="2026-07-01 22:46:23.99405922 +0000 UTC m=+638.557814540" Jul 01 22:46:26.287234 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:26.287192 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:46:32.412985 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:32.412927 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:32.413399 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:32.413014 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:32.425669 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:32.425648 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:32.474512 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:32.474481 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:46:32.539018 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:32.538985 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:46:33.032131 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:33.032106 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c5gtf" Jul 01 22:46:36.929764 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:46:36.929728 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:47:00.300813 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.300767 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt"] Jul 01 22:47:00.306641 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.306618 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.309554 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.309526 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 01 22:47:00.314832 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.314812 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt"] Jul 01 22:47:00.316632 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.316606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.316740 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.316644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.316740 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.316678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wglfh\" (UniqueName: \"kubernetes.io/projected/c1084aa6-c9da-4d2c-ab66-fffb08996084-kube-api-access-wglfh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.316894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.316777 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.316894 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.316866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.316983 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.316956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1084aa6-c9da-4d2c-ab66-fffb08996084-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.397499 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.397469 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:47:00.417497 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.417477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1084aa6-c9da-4d2c-ab66-fffb08996084-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.417600 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.417505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.417600 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.417526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.417600 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.417579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wglfh\" (UniqueName: \"kubernetes.io/projected/c1084aa6-c9da-4d2c-ab66-fffb08996084-kube-api-access-wglfh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.417745 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.417623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.417745 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.417677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.417918 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.417873 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.417989 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.417969 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.418052 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.418037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.419940 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.419920 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1084aa6-c9da-4d2c-ab66-fffb08996084-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.420146 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.420127 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1084aa6-c9da-4d2c-ab66-fffb08996084-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.428741 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.428722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wglfh\" (UniqueName: \"kubernetes.io/projected/c1084aa6-c9da-4d2c-ab66-fffb08996084-kube-api-access-wglfh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wffgt\" (UID: \"c1084aa6-c9da-4d2c-ab66-fffb08996084\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.617862 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.617747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:00.751086 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:00.751058 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt"] Jul 01 22:47:00.753038 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:47:00.753008 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1084aa6_c9da_4d2c_ab66_fffb08996084.slice/crio-5e90b6b195c2cd719b052f8548da7bf9cd1c9d25cd45b1b141385f0880701160 WatchSource:0}: Error finding container 5e90b6b195c2cd719b052f8548da7bf9cd1c9d25cd45b1b141385f0880701160: Status 404 returned error can't find the container with id 5e90b6b195c2cd719b052f8548da7bf9cd1c9d25cd45b1b141385f0880701160 Jul 01 22:47:01.174830 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:01.174769 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" event={"ID":"c1084aa6-c9da-4d2c-ab66-fffb08996084","Type":"ContainerStarted","Data":"15fbb36c7a12449d4a35192bd4864265db78fded59b67a934bd0a970899b9274"} Jul 01 22:47:01.175007 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:01.174856 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" event={"ID":"c1084aa6-c9da-4d2c-ab66-fffb08996084","Type":"ContainerStarted","Data":"5e90b6b195c2cd719b052f8548da7bf9cd1c9d25cd45b1b141385f0880701160"} Jul 01 22:47:01.195386 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:01.195292 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" podStartSLOduration=1.008626837 podStartE2EDuration="1.195276181s" totalImagesPullingTime="186.649344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:47:01.194433333 +0000 UTC m=+675.758188633" watchObservedRunningTime="2026-07-01 22:47:01.195276181 +0000 UTC m=+675.759031481" Jul 01 22:47:01.491252 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:01.491217 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:47:10.618776 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:10.618718 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:10.619279 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:10.618824 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:10.631620 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:10.631590 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:11.240788 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:11.240758 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wffgt" Jul 01 22:47:12.224746 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:12.224694 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:47:13.786506 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:13.786463 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:47:20.101014 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:20.100975 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:47:22.089123 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:22.089078 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:47:32.895738 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.895703 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n"] Jul 01 22:47:32.899391 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.899365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:32.901785 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.901762 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 01 22:47:32.909435 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.909412 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n"] Jul 01 22:47:32.929706 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.929676 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:47:32.999031 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.999003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:32.999031 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.999036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhhh6\" (UniqueName: \"kubernetes.io/projected/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-kube-api-access-rhhh6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:32.999303 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.999083 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:32.999303 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.999228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:32.999303 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.999277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:32.999475 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:32.999310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.100271 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.100232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.100445 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.100278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.100445 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.100307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.100521 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.100475 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.100580 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.100525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhhh6\" (UniqueName: \"kubernetes.io/projected/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-kube-api-access-rhhh6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.100580 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.100561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.100760 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.100746 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.100862 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.100835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.100939 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.100925 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.102703 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.102681 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.102955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.102936 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.108752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.108728 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhhh6\" (UniqueName: \"kubernetes.io/projected/6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe-kube-api-access-rhhh6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n\" (UID: \"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.210702 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.210664 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:33.344770 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:33.344745 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n"] Jul 01 22:47:33.347467 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:47:33.347439 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f31482e_bd9f_4e1d_9e8e_48b2c06b56fe.slice/crio-bb32a3c8eb3cb14bc5dbd68b3a1289ff2ceeeae6e04c30d85a2287250702479a WatchSource:0}: Error finding container bb32a3c8eb3cb14bc5dbd68b3a1289ff2ceeeae6e04c30d85a2287250702479a: Status 404 returned error can't find the container with id bb32a3c8eb3cb14bc5dbd68b3a1289ff2ceeeae6e04c30d85a2287250702479a Jul 01 22:47:34.356631 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:34.356586 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" event={"ID":"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe","Type":"ContainerStarted","Data":"4754cc1b4875485701b3016004d8e8aa1d35235532b57a41ae748a1b77e14768"} Jul 01 22:47:34.356631 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:34.356637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" event={"ID":"6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe","Type":"ContainerStarted","Data":"bb32a3c8eb3cb14bc5dbd68b3a1289ff2ceeeae6e04c30d85a2287250702479a"} Jul 01 22:47:34.372334 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:34.372285 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" podStartSLOduration=2.187299447 podStartE2EDuration="2.372269589s" totalImagesPullingTime="184.970142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:47:34.371507956 +0000 UTC m=+708.935263257" watchObservedRunningTime="2026-07-01 22:47:34.372269589 +0000 UTC m=+708.936024888" Jul 01 22:47:35.491384 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:35.491354 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-thtfc"] Jul 01 22:47:43.210840 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:43.210738 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:43.210840 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:43.210781 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:43.223380 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:43.223358 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:47:43.416530 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:47:43.416499 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n" Jul 01 22:48:58.267004 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:48:58.266945 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:48:58.363597 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:48:58.363568 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:48:59.407643 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:48:59.407612 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:48:59.571287 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:48:59.571255 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:49:04.715352 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:04.715303 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" podUID="55a0c599-d4ab-4ff5-a4d9-2bb54881edf0" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.49:9004: connect: connection refused" Jul 01 22:49:04.865351 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:04.865317 2561 generic.go:356] "Generic (PLEG): container finished" podID="55a0c599-d4ab-4ff5-a4d9-2bb54881edf0" containerID="d04cdeec7cd315c9875529f0bf87dd565a5350577c2e80de748a1564c08f9335" exitCode=2 Jul 01 22:49:04.865520 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:04.865389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" event={"ID":"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0","Type":"ContainerDied","Data":"d04cdeec7cd315c9875529f0bf87dd565a5350577c2e80de748a1564c08f9335"} Jul 01 22:49:04.865752 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:04.865739 2561 scope.go:117] "RemoveContainer" containerID="d04cdeec7cd315c9875529f0bf87dd565a5350577c2e80de748a1564c08f9335" Jul 01 22:49:05.873812 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:05.873762 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" event={"ID":"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0","Type":"ContainerStarted","Data":"33fe01d54356d1c6eca5f80922cc2662a2357c62619146bdc8fd9f1eba7a494a"} Jul 01 22:49:05.874176 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:05.873963 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:49:16.881241 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:16.881157 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:49:36.879847 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:36.879811 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" podUID="55a0c599-d4ab-4ff5-a4d9-2bb54881edf0" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.49:9004: connect: connection refused" Jul 01 22:49:37.044648 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:37.044613 2561 generic.go:356] "Generic (PLEG): container finished" podID="55a0c599-d4ab-4ff5-a4d9-2bb54881edf0" containerID="33fe01d54356d1c6eca5f80922cc2662a2357c62619146bdc8fd9f1eba7a494a" exitCode=2 Jul 01 22:49:37.044831 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:37.044685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" event={"ID":"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0","Type":"ContainerDied","Data":"33fe01d54356d1c6eca5f80922cc2662a2357c62619146bdc8fd9f1eba7a494a"} Jul 01 22:49:37.044831 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:37.044777 2561 scope.go:117] "RemoveContainer" containerID="d04cdeec7cd315c9875529f0bf87dd565a5350577c2e80de748a1564c08f9335" Jul 01 22:49:37.045127 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:37.045105 2561 scope.go:117] "RemoveContainer" containerID="33fe01d54356d1c6eca5f80922cc2662a2357c62619146bdc8fd9f1eba7a494a" Jul 01 22:49:37.045326 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:49:37.045303 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-vd5b9_openshift-ingress(55a0c599-d4ab-4ff5-a4d9-2bb54881edf0)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" podUID="55a0c599-d4ab-4ff5-a4d9-2bb54881edf0" Jul 01 22:49:42.242962 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:42.242934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9ndxz_78bec1d2-4398-4ef7-8f8b-cb7f8636c260/manager/0.log" Jul 01 22:49:42.603808 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:42.603709 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d96464f6-vhjqj_cd660c46-0350-464e-b96b-91fdc31eb35c/copy-manifests/0.log" Jul 01 22:49:42.611587 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:42.611562 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d96464f6-vhjqj_cd660c46-0350-464e-b96b-91fdc31eb35c/manager/0.log" Jul 01 22:49:43.468911 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.468882 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4_7f376cc4-9c00-4e56-b4f5-72611eda0ac3/util/0.log" Jul 01 22:49:43.475505 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.475487 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4_7f376cc4-9c00-4e56-b4f5-72611eda0ac3/pull/0.log" Jul 01 22:49:43.481869 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.481850 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4_7f376cc4-9c00-4e56-b4f5-72611eda0ac3/extract/0.log" Jul 01 22:49:43.586477 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.586457 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q_81cd78ac-90c6-4b24-b092-e09a90fb6108/extract/0.log" Jul 01 22:49:43.592329 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.592310 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q_81cd78ac-90c6-4b24-b092-e09a90fb6108/util/0.log" Jul 01 22:49:43.598574 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.598555 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q_81cd78ac-90c6-4b24-b092-e09a90fb6108/pull/0.log" Jul 01 22:49:43.704852 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.704832 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb_82475db3-880f-46a1-8535-5974dd539738/util/0.log" Jul 01 22:49:43.710693 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.710674 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb_82475db3-880f-46a1-8535-5974dd539738/pull/0.log" Jul 01 22:49:43.716772 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.716754 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb_82475db3-880f-46a1-8535-5974dd539738/extract/0.log" Jul 01 22:49:43.824352 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.824287 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn_51336f41-49f9-4c5c-99d4-f96c593c7c54/util/0.log" Jul 01 22:49:43.830517 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.830497 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn_51336f41-49f9-4c5c-99d4-f96c593c7c54/pull/0.log" Jul 01 22:49:43.836678 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:43.836658 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn_51336f41-49f9-4c5c-99d4-f96c593c7c54/extract/0.log" Jul 01 22:49:44.276887 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:44.276861 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vtzln_63c82215-b8d7-49cc-a26e-9e4177afec25/kuadrant-console-plugin/0.log" Jul 01 22:49:44.391803 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:44.391770 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2dsj8_d43917ba-fbec-4bc3-9f50-5d8c990b1a8a/registry-server/0.log" Jul 01 22:49:44.622177 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:44.622101 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-thtfc_2c8b49c9-e13d-4c1d-be74-a90f775f3133/limitador/0.log" Jul 01 22:49:44.715018 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:44.714992 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:49:44.715358 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:44.715343 2561 scope.go:117] "RemoveContainer" containerID="33fe01d54356d1c6eca5f80922cc2662a2357c62619146bdc8fd9f1eba7a494a" Jul 01 22:49:44.715559 ip-10-0-128-139 kubenswrapper[2561]: E0701 22:49:44.715541 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-vd5b9_openshift-ingress(55a0c599-d4ab-4ff5-a4d9-2bb54881edf0)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" podUID="55a0c599-d4ab-4ff5-a4d9-2bb54881edf0" Jul 01 22:49:44.738244 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:44.738222 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-j6j25_fd47e61a-f7ca-4afe-aba3-65ce9d465575/manager/0.log" Jul 01 22:49:45.071728 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:45.071702 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-656c84dccdln9sg_0daf6726-2f04-4317-af4f-7940012f3dbc/istio-proxy/0.log" Jul 01 22:49:45.520010 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:45.519984 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-qdcq7_79a70606-00ab-4054-9680-c302681ede30/istio-proxy/1.log" Jul 01 22:49:45.733876 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:45.733852 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-vd5b9_55a0c599-d4ab-4ff5-a4d9-2bb54881edf0/payload-processing/1.log" Jul 01 22:49:45.841663 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:45.841595 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6476b4f77-f6lh9_ad82c243-38e9-4439-b86d-da542e92d9ee/router/0.log" Jul 01 22:49:46.275328 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:46.275299 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-c5gtf_4828cd50-1ac0-4715-b1f9-3ef37f78eaa5/main/0.log" Jul 01 22:49:46.382831 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:46.382806 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-wffgt_c1084aa6-c9da-4d2c-ab66-fffb08996084/main/0.log" Jul 01 22:49:46.707159 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:46.707134 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-2vp9n_6f31482e-bd9f-4e1d-9e8e-48b2c06b56fe/main/0.log" Jul 01 22:49:46.880375 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:46.880348 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:49:46.880736 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:46.880610 2561 scope.go:117] "RemoveContainer" containerID="33fe01d54356d1c6eca5f80922cc2662a2357c62619146bdc8fd9f1eba7a494a" Jul 01 22:49:47.107661 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:47.107582 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" event={"ID":"55a0c599-d4ab-4ff5-a4d9-2bb54881edf0","Type":"ContainerStarted","Data":"54bf5ae9c375cb9cb1739dfe5b37be398e6d66832a3fe39c37db2120d8ca786c"} Jul 01 22:49:47.107809 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:47.107778 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:49:50.238694 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.238660 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjf5b/must-gather-zp4pf"] Jul 01 22:49:50.242308 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.242290 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjf5b/must-gather-zp4pf" Jul 01 22:49:50.245215 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.245195 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjf5b\"/\"kube-root-ca.crt\"" Jul 01 22:49:50.246062 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.246042 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjf5b\"/\"default-dockercfg-72vmj\"" Jul 01 22:49:50.246062 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.246054 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjf5b\"/\"openshift-service-ca.crt\"" Jul 01 22:49:50.258081 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.258059 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjf5b/must-gather-zp4pf"] Jul 01 22:49:50.263700 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.263674 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:49:50.359211 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.359171 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" limit=1024 Jul 01 22:49:50.392925 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.392888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f43bd98-a2fa-4601-a8e1-a8aa4295035f-must-gather-output\") pod \"must-gather-zp4pf\" (UID: \"1f43bd98-a2fa-4601-a8e1-a8aa4295035f\") " pod="openshift-must-gather-sjf5b/must-gather-zp4pf" Jul 01 22:49:50.393073 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.393007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5pl\" (UniqueName: \"kubernetes.io/projected/1f43bd98-a2fa-4601-a8e1-a8aa4295035f-kube-api-access-gs5pl\") pod \"must-gather-zp4pf\" (UID: \"1f43bd98-a2fa-4601-a8e1-a8aa4295035f\") " pod="openshift-must-gather-sjf5b/must-gather-zp4pf" Jul 01 22:49:50.494002 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.493918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f43bd98-a2fa-4601-a8e1-a8aa4295035f-must-gather-output\") pod \"must-gather-zp4pf\" (UID: \"1f43bd98-a2fa-4601-a8e1-a8aa4295035f\") " pod="openshift-must-gather-sjf5b/must-gather-zp4pf" Jul 01 22:49:50.494002 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.493999 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5pl\" (UniqueName: \"kubernetes.io/projected/1f43bd98-a2fa-4601-a8e1-a8aa4295035f-kube-api-access-gs5pl\") pod \"must-gather-zp4pf\" (UID: \"1f43bd98-a2fa-4601-a8e1-a8aa4295035f\") " pod="openshift-must-gather-sjf5b/must-gather-zp4pf" Jul 01 22:49:50.494248 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.494230 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f43bd98-a2fa-4601-a8e1-a8aa4295035f-must-gather-output\") pod \"must-gather-zp4pf\" (UID: \"1f43bd98-a2fa-4601-a8e1-a8aa4295035f\") " pod="openshift-must-gather-sjf5b/must-gather-zp4pf" Jul 01 22:49:50.510349 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.510321 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5pl\" (UniqueName: \"kubernetes.io/projected/1f43bd98-a2fa-4601-a8e1-a8aa4295035f-kube-api-access-gs5pl\") pod \"must-gather-zp4pf\" (UID: \"1f43bd98-a2fa-4601-a8e1-a8aa4295035f\") " pod="openshift-must-gather-sjf5b/must-gather-zp4pf" Jul 01 22:49:50.551432 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.551405 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjf5b/must-gather-zp4pf" Jul 01 22:49:50.701156 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:50.701133 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjf5b/must-gather-zp4pf"] Jul 01 22:49:50.703444 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:49:50.703412 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f43bd98_a2fa_4601_a8e1_a8aa4295035f.slice/crio-9c5b8a61867a4ee4c241bd930ceb3cb70679ec5a7fa8ef580ee3fafd3f6f3e5a WatchSource:0}: Error finding container 9c5b8a61867a4ee4c241bd930ceb3cb70679ec5a7fa8ef580ee3fafd3f6f3e5a: Status 404 returned error can't find the container with id 9c5b8a61867a4ee4c241bd930ceb3cb70679ec5a7fa8ef580ee3fafd3f6f3e5a Jul 01 22:49:51.130616 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:51.130580 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjf5b/must-gather-zp4pf" event={"ID":"1f43bd98-a2fa-4601-a8e1-a8aa4295035f","Type":"ContainerStarted","Data":"9c5b8a61867a4ee4c241bd930ceb3cb70679ec5a7fa8ef580ee3fafd3f6f3e5a"} Jul 01 22:49:52.141300 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:52.141251 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjf5b/must-gather-zp4pf" event={"ID":"1f43bd98-a2fa-4601-a8e1-a8aa4295035f","Type":"ContainerStarted","Data":"c09780171828022553b822e90fe2484c02959b118014dbfa81e1c483108b6a1c"} Jul 01 22:49:52.141664 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:52.141304 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjf5b/must-gather-zp4pf" event={"ID":"1f43bd98-a2fa-4601-a8e1-a8aa4295035f","Type":"ContainerStarted","Data":"f5ece6ac08fc02f3de7e3c823308e2ed84acc39535963c013247d7ad2051fe00"} Jul 01 22:49:53.166329 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:53.166298 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k9f7s_229c282a-5503-4f16-9dd1-48eff34a1972/global-pull-secret-syncer/0.log" Jul 01 22:49:53.257747 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:53.257720 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hhcls_8be253c7-946e-4e03-a6a9-b93dbb386cdd/konnectivity-agent/0.log" Jul 01 22:49:53.327164 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:53.327135 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-139.ec2.internal_d46c7e440d3290353ae564bd45a93d28/haproxy/0.log" Jul 01 22:49:57.621612 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.621565 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4_7f376cc4-9c00-4e56-b4f5-72611eda0ac3/extract/0.log" Jul 01 22:49:57.645846 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.645749 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4_7f376cc4-9c00-4e56-b4f5-72611eda0ac3/util/0.log" Jul 01 22:49:57.682394 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.682363 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k9ns4_7f376cc4-9c00-4e56-b4f5-72611eda0ac3/pull/0.log" Jul 01 22:49:57.711089 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.711001 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q_81cd78ac-90c6-4b24-b092-e09a90fb6108/extract/0.log" Jul 01 22:49:57.736094 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.736020 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q_81cd78ac-90c6-4b24-b092-e09a90fb6108/util/0.log" Jul 01 22:49:57.763468 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.763433 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lj46q_81cd78ac-90c6-4b24-b092-e09a90fb6108/pull/0.log" Jul 01 22:49:57.795596 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.795567 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb_82475db3-880f-46a1-8535-5974dd539738/extract/0.log" Jul 01 22:49:57.820560 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.820522 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb_82475db3-880f-46a1-8535-5974dd539738/util/0.log" Jul 01 22:49:57.845733 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.845705 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bkmgb_82475db3-880f-46a1-8535-5974dd539738/pull/0.log" Jul 01 22:49:57.877329 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.877138 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn_51336f41-49f9-4c5c-99d4-f96c593c7c54/extract/0.log" Jul 01 22:49:57.900505 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.900427 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn_51336f41-49f9-4c5c-99d4-f96c593c7c54/util/0.log" Jul 01 22:49:57.926356 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:57.926306 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxmzn_51336f41-49f9-4c5c-99d4-f96c593c7c54/pull/0.log" Jul 01 22:49:58.055816 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:58.055774 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vtzln_63c82215-b8d7-49cc-a26e-9e4177afec25/kuadrant-console-plugin/0.log" Jul 01 22:49:58.087988 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:58.087955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2dsj8_d43917ba-fbec-4bc3-9f50-5d8c990b1a8a/registry-server/0.log" Jul 01 22:49:58.115922 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:58.115886 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-vd5b9" Jul 01 22:49:58.137007 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:58.136905 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sjf5b/must-gather-zp4pf" podStartSLOduration=7.341000491 podStartE2EDuration="8.136885082s" totalImagesPullingTime="795.884591ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:49:52.15739259 +0000 UTC m=+846.721148084" watchObservedRunningTime="2026-07-01 22:49:58.136885082 +0000 UTC m=+852.700640381" Jul 01 22:49:58.184697 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:58.183874 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-thtfc_2c8b49c9-e13d-4c1d-be74-a90f775f3133/limitador/0.log" Jul 01 22:49:58.242342 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:49:58.242313 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-j6j25_fd47e61a-f7ca-4afe-aba3-65ce9d465575/manager/0.log" Jul 01 22:50:00.188587 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:00.188539 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-vv9k4_dec17bdc-1d33-4d3d-b1ca-f353f8b91bc4/cluster-monitoring-operator/0.log" Jul 01 22:50:00.556313 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:00.556275 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tcn8d_94b2b55b-b7a8-4f2f-9986-51ad042f92d4/node-exporter/0.log" Jul 01 22:50:00.584423 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:00.584377 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tcn8d_94b2b55b-b7a8-4f2f-9986-51ad042f92d4/kube-rbac-proxy/0.log" Jul 01 22:50:00.616989 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:00.616960 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tcn8d_94b2b55b-b7a8-4f2f-9986-51ad042f92d4/init-textfile/0.log" Jul 01 22:50:00.971440 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:00.971405 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-rr78r_1380e2fa-2664-4fd1-9492-f66b692da3d6/prometheus-operator-admission-webhook/0.log" Jul 01 22:50:02.371652 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:02.371624 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-xnfcq_b6a883c5-6aff-426a-91a5-cd0072571fab/networking-console-plugin/0.log" Jul 01 22:50:03.023700 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.023668 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/2.log" Jul 01 22:50:03.029503 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.029472 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-9wckq_28aa0edc-b179-4962-97f2-32eb340bff4e/console-operator/3.log" Jul 01 22:50:03.521577 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.521538 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj"] Jul 01 22:50:03.525948 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.525920 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.534701 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.534667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-sys\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.534864 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.534720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-proc\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.534864 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.534810 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-podres\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.534864 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.534838 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmxkr\" (UniqueName: \"kubernetes.io/projected/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-kube-api-access-kmxkr\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.535044 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.534870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-lib-modules\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.535044 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.534999 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj"] Jul 01 22:50:03.592232 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.592167 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77fcd9d55f-l5k54_e531bb70-8499-429a-b111-57978746cd91/console/0.log" Jul 01 22:50:03.636040 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.636002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-podres\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.636293 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.636269 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmxkr\" (UniqueName: \"kubernetes.io/projected/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-kube-api-access-kmxkr\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.636430 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.636412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-lib-modules\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.636621 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.636602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-sys\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.636784 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.636766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-proc\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.636996 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.636775 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-sys\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.637102 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.636290 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-podres\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.637202 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.636864 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-proc\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.637290 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.637002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-lib-modules\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.646040 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.645195 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmxkr\" (UniqueName: \"kubernetes.io/projected/ca36b2c3-a6a7-47f8-b798-064cf3a9a685-kube-api-access-kmxkr\") pod \"perf-node-gather-daemonset-gchcj\" (UID: \"ca36b2c3-a6a7-47f8-b798-064cf3a9a685\") " pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:03.849392 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:03.849312 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:04.024627 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:04.024570 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj"] Jul 01 22:50:04.027014 ip-10-0-128-139 kubenswrapper[2561]: W0701 22:50:04.026962 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podca36b2c3_a6a7_47f8_b798_064cf3a9a685.slice/crio-62168a9390ec23add77d2aa58ff7710f09a3a1a4962710276e5b99bc578c3893 WatchSource:0}: Error finding container 62168a9390ec23add77d2aa58ff7710f09a3a1a4962710276e5b99bc578c3893: Status 404 returned error can't find the container with id 62168a9390ec23add77d2aa58ff7710f09a3a1a4962710276e5b99bc578c3893 Jul 01 22:50:04.240955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:04.240346 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" event={"ID":"ca36b2c3-a6a7-47f8-b798-064cf3a9a685","Type":"ContainerStarted","Data":"b151713d580f3d458eac6eb0b85841c562324acef6933068096372b896328e3e"} Jul 01 22:50:04.240955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:04.240404 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" event={"ID":"ca36b2c3-a6a7-47f8-b798-064cf3a9a685","Type":"ContainerStarted","Data":"62168a9390ec23add77d2aa58ff7710f09a3a1a4962710276e5b99bc578c3893"} Jul 01 22:50:04.240955 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:04.240595 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:04.257161 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:04.257113 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" podStartSLOduration=1.257092483 podStartE2EDuration="1.257092483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:50:04.254914853 +0000 UTC m=+858.818670156" watchObservedRunningTime="2026-07-01 22:50:04.257092483 +0000 UTC m=+858.820847777" Jul 01 22:50:04.282400 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:04.282374 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-s68b2_cf1c6459-5adf-471e-8f9d-8fbd758ab16e/volume-data-source-validator/0.log" Jul 01 22:50:05.299239 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:05.299210 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b85ls_d81d0a19-3054-4831-967e-e3ee294084a4/dns/0.log" Jul 01 22:50:05.321252 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:05.321224 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b85ls_d81d0a19-3054-4831-967e-e3ee294084a4/kube-rbac-proxy/0.log" Jul 01 22:50:05.493842 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:05.493807 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xg8h2_88133730-336e-4b16-b84e-d0ec10ab6e57/dns-node-resolver/0.log" Jul 01 22:50:06.142026 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:06.141989 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fphh_9050c27a-17ba-471f-a3e8-ce4a6886ce5a/node-ca/0.log" Jul 01 22:50:07.224972 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:07.224941 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-656c84dccdln9sg_0daf6726-2f04-4317-af4f-7940012f3dbc/istio-proxy/0.log" Jul 01 22:50:07.353917 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:07.353879 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-qdcq7_79a70606-00ab-4054-9680-c302681ede30/istio-proxy/1.log" Jul 01 22:50:07.354135 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:07.354114 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-qdcq7_79a70606-00ab-4054-9680-c302681ede30/istio-proxy/0.log" Jul 01 22:50:07.412667 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:07.412636 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-vd5b9_55a0c599-d4ab-4ff5-a4d9-2bb54881edf0/payload-processing/2.log" Jul 01 22:50:07.413781 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:07.413760 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-vd5b9_55a0c599-d4ab-4ff5-a4d9-2bb54881edf0/payload-processing/1.log" Jul 01 22:50:07.439743 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:07.439706 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6476b4f77-f6lh9_ad82c243-38e9-4439-b86d-da542e92d9ee/router/0.log" Jul 01 22:50:08.126237 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:08.126204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v829d_1d557ef6-44e8-41a3-bc26-dcedb2f865bb/serve-healthcheck-canary/0.log" Jul 01 22:50:08.663187 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:08.663147 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-kntrj_7c079d5a-ede0-43d8-8ee5-c9b778d53386/insights-operator/1.log" Jul 01 22:50:08.663655 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:08.663387 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-kntrj_7c079d5a-ede0-43d8-8ee5-c9b778d53386/insights-operator/0.log" Jul 01 22:50:08.705987 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:08.705952 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bb8hk_382757d3-0804-4b97-88c7-ecd21d46cc13/kube-rbac-proxy/0.log" Jul 01 22:50:08.739993 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:08.739966 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bb8hk_382757d3-0804-4b97-88c7-ecd21d46cc13/exporter/0.log" Jul 01 22:50:08.786316 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:08.786284 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bb8hk_382757d3-0804-4b97-88c7-ecd21d46cc13/extractor/0.log" Jul 01 22:50:10.263246 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:10.263211 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjf5b/perf-node-gather-daemonset-gchcj" Jul 01 22:50:11.317315 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:11.317281 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9ndxz_78bec1d2-4398-4ef7-8f8b-cb7f8636c260/manager/0.log" Jul 01 22:50:11.461587 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:11.461560 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d96464f6-vhjqj_cd660c46-0350-464e-b96b-91fdc31eb35c/manager/0.log" Jul 01 22:50:11.489051 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:11.489021 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d96464f6-vhjqj_cd660c46-0350-464e-b96b-91fdc31eb35c/copy-manifests/0.log" Jul 01 22:50:13.015103 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:13.015068 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bb7dc95cc-mcvg2_853c1ba2-d01c-4a02-8044-28b845f0f002/manager/0.log" Jul 01 22:50:13.382700 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:13.382661 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-656c84dccdln9sg_0daf6726-2f04-4317-af4f-7940012f3dbc/istio-proxy/0.log" Jul 01 22:50:13.477119 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:13.477089 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-qdcq7_79a70606-00ab-4054-9680-c302681ede30/istio-proxy/1.log" Jul 01 22:50:13.477346 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:13.477327 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-qdcq7_79a70606-00ab-4054-9680-c302681ede30/istio-proxy/0.log" Jul 01 22:50:13.509866 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:13.509825 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-vd5b9_55a0c599-d4ab-4ff5-a4d9-2bb54881edf0/payload-processing/2.log" Jul 01 22:50:13.511053 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:13.510925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-vd5b9_55a0c599-d4ab-4ff5-a4d9-2bb54881edf0/payload-processing/1.log" Jul 01 22:50:13.526259 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:13.526207 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6476b4f77-f6lh9_ad82c243-38e9-4439-b86d-da542e92d9ee/router/0.log" Jul 01 22:50:14.585981 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:14.585951 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-656c84dccdln9sg_0daf6726-2f04-4317-af4f-7940012f3dbc/istio-proxy/0.log" Jul 01 22:50:14.683196 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:14.683166 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-qdcq7_79a70606-00ab-4054-9680-c302681ede30/istio-proxy/1.log" Jul 01 22:50:14.683447 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:14.683427 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-qdcq7_79a70606-00ab-4054-9680-c302681ede30/istio-proxy/0.log" Jul 01 22:50:14.718608 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:14.718577 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-vd5b9_55a0c599-d4ab-4ff5-a4d9-2bb54881edf0/payload-processing/2.log" Jul 01 22:50:14.719209 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:14.719194 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-vd5b9_55a0c599-d4ab-4ff5-a4d9-2bb54881edf0/payload-processing/1.log" Jul 01 22:50:14.735032 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:14.735003 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6476b4f77-f6lh9_ad82c243-38e9-4439-b86d-da542e92d9ee/router/0.log" Jul 01 22:50:18.534169 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:18.534137 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-rg4dj_2eec3495-46ac-42d8-b407-be057f6ae1d7/kube-storage-version-migrator-operator/1.log" Jul 01 22:50:18.534963 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:18.534943 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-rg4dj_2eec3495-46ac-42d8-b407-be057f6ae1d7/kube-storage-version-migrator-operator/0.log" Jul 01 22:50:19.986173 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:19.986142 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6hdw_336fb92b-16f8-45d9-94c8-56f4589349e9/kube-multus-additional-cni-plugins/0.log" Jul 01 22:50:20.011277 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:20.011241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6hdw_336fb92b-16f8-45d9-94c8-56f4589349e9/egress-router-binary-copy/0.log" Jul 01 22:50:20.035247 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:20.035222 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6hdw_336fb92b-16f8-45d9-94c8-56f4589349e9/cni-plugins/0.log" Jul 01 22:50:20.058930 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:20.058903 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6hdw_336fb92b-16f8-45d9-94c8-56f4589349e9/bond-cni-plugin/0.log" Jul 01 22:50:20.084068 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:20.084047 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6hdw_336fb92b-16f8-45d9-94c8-56f4589349e9/routeoverride-cni/0.log" Jul 01 22:50:20.107628 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:20.107604 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6hdw_336fb92b-16f8-45d9-94c8-56f4589349e9/whereabouts-cni-bincopy/0.log" Jul 01 22:50:20.131261 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:20.131240 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6hdw_336fb92b-16f8-45d9-94c8-56f4589349e9/whereabouts-cni/0.log" Jul 01 22:50:20.218225 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:20.218175 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pkjrx_60e99142-dfa9-4b5d-a05d-9de40d049de7/kube-multus/0.log" Jul 01 22:50:20.338708 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:20.338622 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r8wqz_9e6b90a5-73e8-4552-b7a3-d2e2b56674f4/network-metrics-daemon/0.log" Jul 01 22:50:20.361293 ip-10-0-128-139 kubenswrapper[2561]: I0701 22:50:20.361262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r8wqz_9e6b90a5-73e8-4552-b7a3-d2e2b56674f4/kube-rbac-proxy/0.log"