Jul 28 16:19:36.227093 ip-10-0-134-69 systemd[1]: Starting Kubernetes Kubelet... Jul 28 16:19:36.606082 ip-10-0-134-69 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 16:19:36.606082 ip-10-0-134-69 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 16:19:36.606082 ip-10-0-134-69 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 16:19:36.606082 ip-10-0-134-69 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 16:19:36.606082 ip-10-0-134-69 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 16:19:36.607474 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.607402 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 16:19:36.610761 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610746 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:19:36.610761 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610761 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610765 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610769 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610771 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610787 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610794 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610801 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610806 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610810 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610821 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610825 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610828 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610831 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610834 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610837 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610840 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:19:36.610836 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610843 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610846 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610849 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610851 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610854 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610856 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610859 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610862 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610864 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610867 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610870 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610872 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610875 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610877 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610880 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610882 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610885 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610887 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610890 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:19:36.611207 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610892 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610895 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610898 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610901 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610903 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610905 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610908 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610910 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610913 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610915 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610918 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610920 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610922 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610925 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610927 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610930 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610933 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610935 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610938 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610940 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:19:36.611650 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610943 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610946 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610948 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610951 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610953 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610956 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610958 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610961 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610963 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610966 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610969 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610971 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610974 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610976 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610978 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610981 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610984 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610986 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610989 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610991 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:19:36.612133 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610993 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610996 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.610998 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611000 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611003 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611005 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611008 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611011 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611013 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611016 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611018 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611021 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611023 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611027 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611030 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611033 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611036 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611038 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611041 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611043 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:19:36.612596 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611046 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611048 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611051 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611715 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611722 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611727 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611730 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611733 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611737 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611742 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611745 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611748 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611751 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611754 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611756 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611759 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611761 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611764 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611766 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:19:36.613069 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611770 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611773 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611789 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611792 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611794 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611797 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611800 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611803 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611805 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611808 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611810 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611813 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611815 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611818 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611820 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611822 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611825 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611827 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611830 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:19:36.613521 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611833 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611835 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611838 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611842 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611845 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611848 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611852 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611855 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611858 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611861 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611863 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611866 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611868 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611873 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611876 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611879 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611882 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611884 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611887 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611890 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:19:36.613993 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611893 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611895 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611898 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611900 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611902 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611905 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611907 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611910 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611912 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611915 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611917 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611919 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611922 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611924 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611927 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611929 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611932 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611934 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611937 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611939 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:19:36.614473 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611942 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611946 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611949 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611952 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611955 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611960 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611963 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611965 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611968 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611971 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611973 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611976 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611979 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611981 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611983 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611986 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611989 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611991 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611994 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611996 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:19:36.614960 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.611998 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612001 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612003 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612006 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612345 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612349 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612352 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612355 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612358 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612360 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612363 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612365 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612368 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612370 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612373 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612375 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612378 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612382 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612385 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612387 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:19:36.615442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612390 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612393 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612395 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612398 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612400 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612403 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612406 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612408 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612411 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612414 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612418 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612421 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612424 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612427 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612429 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612432 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612434 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612437 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612440 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:19:36.615939 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612443 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612445 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612448 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612451 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612453 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612456 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612458 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612460 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612463 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612466 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612469 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612472 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612475 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612477 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612480 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612482 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612485 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612487 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612490 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612492 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:19:36.616389 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612495 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612497 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612499 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612503 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612505 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612507 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612510 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612512 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612515 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612517 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612520 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612522 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612525 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612527 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612529 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612532 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612534 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612537 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612539 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612542 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:19:36.616884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612544 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612547 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612551 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612553 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612556 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612558 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612561 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612563 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612565 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612568 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612570 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612573 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612575 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612578 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612580 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612583 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612585 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612589 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612592 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:19:36.617388 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612595 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612598 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612601 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612604 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.612607 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612673 2549 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612680 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612717 2549 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612722 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612727 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612730 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612734 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612738 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612741 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612744 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612748 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612751 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612754 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612757 2549 flags.go:64] FLAG: --cgroup-root="" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612760 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612763 2549 flags.go:64] FLAG: --client-ca-file="" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612765 2549 flags.go:64] FLAG: --cloud-provider="external" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612768 2549 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 16:19:36.617850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612772 2549 flags.go:64] FLAG: --cluster-domain="" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612786 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612789 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612792 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612795 2549 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612798 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612801 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612804 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612807 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612810 2549 flags.go:64] FLAG: --contention-profiling="false" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612813 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612816 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612819 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612821 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612825 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612828 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612831 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612834 2549 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612836 2549 flags.go:64] FLAG: --enable-server="true" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612840 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612844 2549 flags.go:64] FLAG: --event-burst="100" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612847 2549 flags.go:64] FLAG: --event-qps="50" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612849 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612854 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 16:19:36.618374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612857 2549 flags.go:64] FLAG: --eviction-hard="" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612863 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612866 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612869 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612872 2549 flags.go:64] FLAG: --eviction-soft="" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612875 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612878 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612881 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612884 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612887 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612890 2549 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612892 2549 flags.go:64] FLAG: --feature-gates="" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612896 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612899 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612901 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612904 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612907 2549 flags.go:64] FLAG: --healthz-port="10248" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612910 2549 flags.go:64] FLAG: --help="false" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612913 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-134-69.ec2.internal" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612916 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612919 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612921 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612925 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 16:19:36.619017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612928 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612931 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612934 2549 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612936 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612939 2549 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612942 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612946 2549 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612948 2549 flags.go:64] FLAG: --kube-reserved="" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612953 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612955 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612958 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612961 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612964 2549 flags.go:64] FLAG: --lock-file="" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612967 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612969 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612972 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612978 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612980 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612983 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612985 2549 flags.go:64] FLAG: --logging-format="text" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612988 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612991 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612994 2549 flags.go:64] FLAG: --manifest-url="" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.612997 2549 flags.go:64] FLAG: --manifest-url-header="" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613001 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 16:19:36.619595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613004 2549 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613008 2549 flags.go:64] FLAG: --max-pods="110" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613010 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613013 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613016 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613019 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613022 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613024 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613027 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613033 2549 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613037 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613040 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613043 2549 flags.go:64] FLAG: --pod-cidr="" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613046 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613050 2549 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613054 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613058 2549 flags.go:64] FLAG: --pods-per-core="0" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613060 2549 flags.go:64] FLAG: --port="10250" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613063 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613066 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f9ebe5c9bebaa597" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613070 2549 flags.go:64] FLAG: --qos-reserved="" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613073 2549 flags.go:64] FLAG: --read-only-port="10255" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613076 2549 flags.go:64] FLAG: --register-node="true" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613079 2549 flags.go:64] FLAG: --register-with-taints="" Jul 28 16:19:36.620193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613082 2549 flags.go:64] FLAG: --registry-burst="10" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613085 2549 flags.go:64] FLAG: --registry-qps="5" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613087 2549 flags.go:64] FLAG: --reserved-cpus="" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613090 2549 flags.go:64] FLAG: --reserved-memory="" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613093 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613096 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613099 2549 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613101 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613104 2549 flags.go:64] FLAG: --runonce="false" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613107 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613110 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613112 2549 flags.go:64] FLAG: --seccomp-default="false" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613115 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613118 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613120 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613125 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613127 2549 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613130 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613133 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613136 2549 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613138 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613141 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613144 2549 flags.go:64] FLAG: --system-cgroups="" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613148 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613154 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 16:19:36.620762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613156 2549 flags.go:64] FLAG: --tls-cert-file="" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613159 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613163 2549 flags.go:64] FLAG: --tls-min-version="" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613165 2549 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613168 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613171 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613174 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613176 2549 flags.go:64] FLAG: --v="2" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613180 2549 flags.go:64] FLAG: --version="false" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613184 2549 flags.go:64] FLAG: --vmodule="" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613188 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613191 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613305 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613309 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613312 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613315 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613318 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613321 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613324 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613326 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613329 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613332 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613337 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:19:36.621366 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613339 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613342 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613345 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613347 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613350 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613352 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613355 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613359 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613361 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613364 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613367 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613369 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613372 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613375 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613378 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613380 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613382 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613385 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613388 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613391 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:19:36.622255 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613393 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613396 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613398 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613401 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613403 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613406 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613408 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613411 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613413 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613415 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613418 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613422 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613424 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613427 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613429 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613432 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613434 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613439 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613442 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613446 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:19:36.623054 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613449 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613452 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613454 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613457 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613459 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613462 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613464 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613467 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613469 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613472 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613474 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613477 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613480 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613482 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613485 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613487 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613489 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613492 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613496 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:19:36.623552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613500 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613502 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613505 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613508 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613511 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613514 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613516 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613519 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613522 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613524 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613527 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613529 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613533 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613536 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613539 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613541 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613544 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613546 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613549 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613551 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:19:36.624016 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613554 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613556 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613560 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613563 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613566 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613569 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613572 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613575 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.613578 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.613583 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.619881 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.619894 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.619914 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.619919 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 16:19:36.624500 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619969 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619974 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619977 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619980 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619982 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619985 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619987 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619990 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619993 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619996 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.619998 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620001 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620003 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620006 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620008 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620011 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620015 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620018 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620021 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620025 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:19:36.624884 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620029 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620031 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620034 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620037 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620039 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620042 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620045 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620047 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620049 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620053 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620055 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620058 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620060 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620063 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620065 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620068 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620071 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620074 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620076 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620078 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:19:36.625354 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620081 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620084 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620087 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620089 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620092 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620094 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620097 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620099 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620102 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620104 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620106 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620109 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620112 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620115 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620117 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620120 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620122 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620125 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620127 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620130 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:19:36.625835 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620133 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620135 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620138 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620141 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620143 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620146 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620149 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620151 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620154 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620156 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620159 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620162 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620165 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620167 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620170 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620173 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620175 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620178 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620181 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:19:36.626308 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620183 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620186 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620189 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620191 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620194 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620196 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620199 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620202 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620204 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620207 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620210 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620213 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620216 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620220 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620223 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620225 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620228 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620231 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620234 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:19:36.626744 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620236 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.620241 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620361 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620365 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620369 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620372 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620375 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620377 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620380 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620383 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620387 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620391 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620393 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620396 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620399 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:19:36.627211 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620401 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620405 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620408 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620411 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620414 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620417 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620419 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620422 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620424 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620427 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620430 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620432 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620435 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620437 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620439 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620442 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620444 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620448 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620451 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:19:36.627586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620454 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620456 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620459 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620462 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620464 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620467 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620469 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620472 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620475 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620477 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620479 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620482 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620484 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620486 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620489 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620491 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620494 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620496 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620499 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620501 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:19:36.628039 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620503 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620506 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620508 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620511 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620513 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620516 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620518 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620521 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620523 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620526 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620529 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620531 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620533 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620536 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620538 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620541 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620543 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620545 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620548 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:19:36.628520 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620550 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620553 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620555 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620558 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620560 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620562 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620565 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620567 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620569 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620572 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620575 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620577 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620580 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620582 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620584 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620587 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620590 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620592 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620594 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620597 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:19:36.629065 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620599 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620601 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620604 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620607 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620609 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620612 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620614 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:36.620616 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.620621 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.620706 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.624062 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.625306 2549 server.go:1019] "Starting client certificate rotation" Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.625406 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 16:19:36.629586 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.625437 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 16:19:36.629937 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.628210 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 16:19:36.629937 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.629250 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 16:19:36.639493 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.639476 2549 log.go:25] "Validated CRI v1 runtime API" Jul 28 16:19:36.642584 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.642569 2549 log.go:25] "Validated CRI v1 image API" Jul 28 16:19:36.644038 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.644022 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 16:19:36.646447 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.646426 2549 fs.go:135] Filesystem UUIDs: map[09a615a3-0d5b-42e4-95c7-b64e3a99eba2:/dev/nvme0n1p4 33542049-7c2a-4370-a4e1-3b88844f737f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 28 16:19:36.646534 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.646445 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 16:19:36.651349 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.651246 2549 manager.go:216] Machine: {Timestamp:2026-07-28 16:19:36.649873685 +0000 UTC m=+0.312182932 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200873 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a8f2aa541e801b0761507b68344a9 SystemUUID:ec2a8f2a-a541-e801-b076-1507b68344a9 BootID:48c5cb24-0513-46c0-8ecc-793c3ec54516 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:80:f8:a5:3d:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:80:f8:a5:3d:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:f7:c3:48:7f:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 16:19:36.651349 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.651340 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 16:19:36.651490 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.651458 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 16:19:36.653126 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.653104 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 16:19:36.653263 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.653136 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-69.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 16:19:36.653810 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.653800 2549 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 16:19:36.653840 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.653812 2549 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 16:19:36.653840 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.653820 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 16:19:36.654433 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.654424 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 16:19:36.655855 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.655842 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 16:19:36.657359 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.657339 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 16:19:36.659327 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.659313 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 28 16:19:36.659429 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.659420 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 16:19:36.659465 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.659448 2549 kubelet.go:486] "Attempting to sync node with API server" Jul 28 16:19:36.659465 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.659460 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 16:19:36.659523 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.659473 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 16:19:36.659523 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.659486 2549 kubelet.go:398] "Adding apiserver pod source" Jul 28 16:19:36.659523 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.659494 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 16:19:36.659989 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.659974 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 16:19:36.660023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.660010 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 16:19:36.663845 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.663823 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 16:19:36.665097 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.665084 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 16:19:36.665160 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.665112 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 16:19:36.666173 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666161 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 16:19:36.666217 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666179 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 16:19:36.666217 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666184 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 16:19:36.666217 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666189 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 16:19:36.666217 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666215 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 16:19:36.666325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666220 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 16:19:36.666325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666228 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 16:19:36.666325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666233 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 16:19:36.666325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666239 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 16:19:36.666325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666244 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 16:19:36.666325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666252 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 16:19:36.666325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.666257 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 16:19:36.667202 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.667193 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 16:19:36.667202 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.667201 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 16:19:36.670149 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.670124 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-69.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 16:19:36.670219 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.670154 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 16:19:36.670219 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.670172 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 16:19:36.670467 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.670455 2549 server.go:1268] "Started kubelet" Jul 28 16:19:36.670545 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.670525 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 16:19:36.670597 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.670532 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 16:19:36.670597 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.670586 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 16:19:36.671260 ip-10-0-134-69 systemd[1]: Started Kubernetes Kubelet. Jul 28 16:19:36.672523 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.672499 2549 server.go:310] "Adding debug handlers to kubelet server" Jul 28 16:19:36.673332 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.673246 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 16:19:36.678462 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.678431 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 16:19:36.679859 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.678943 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-69.ec2.internal.18c6807d00b9d26b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-69.ec2.internal,UID:ip-10-0-134-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-69.ec2.internal,},FirstTimestamp:2026-07-28 16:19:36.670425707 +0000 UTC m=+0.332734954,LastTimestamp:2026-07-28 16:19:36.670425707 +0000 UTC m=+0.332734954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-69.ec2.internal,}" Jul 28 16:19:36.680019 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.679998 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 16:19:36.680019 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.680008 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 16:19:36.680139 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.680119 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:36.680799 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.680770 2549 factory.go:55] Registering systemd factory Jul 28 16:19:36.680799 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.680798 2549 factory.go:223] Registration of the systemd container factory successfully Jul 28 16:19:36.680931 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.680804 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 16:19:36.680931 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.680804 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 16:19:36.680931 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.680821 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 16:19:36.680931 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.680928 2549 reconstruct.go:97] "Volume reconstruction finished" Jul 28 16:19:36.680931 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.680934 2549 reconciler.go:29] "Reconciler: start to sync state" Jul 28 16:19:36.681162 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.681003 2549 factory.go:153] Registering CRI-O factory Jul 28 16:19:36.681162 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.681013 2549 factory.go:223] Registration of the crio container factory successfully Jul 28 16:19:36.681162 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.681051 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 16:19:36.681162 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.681073 2549 factory.go:103] Registering Raw factory Jul 28 16:19:36.681162 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.681090 2549 manager.go:1196] Started watching for new ooms in manager Jul 28 16:19:36.681902 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.681883 2549 manager.go:349] Starting recovery of all containers Jul 28 16:19:36.684191 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.684158 2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 16:19:36.684277 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.684193 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 16:19:36.693145 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.693127 2549 manager.go:354] Recovery completed Jul 28 16:19:36.699510 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.699498 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:19:36.701307 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.701293 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:19:36.701370 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.701317 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:19:36.701370 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.701327 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:19:36.701813 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.701801 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 16:19:36.701852 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.701815 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 16:19:36.701852 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.701832 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 28 16:19:36.701928 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.701806 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:19:36.702524 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.702507 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:19:36.702577 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.702535 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:19:36.702577 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.702546 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:19:36.703081 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.703066 2549 policy_none.go:49] "None policy: Start" Jul 28 16:19:36.703159 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.703086 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 16:19:36.703159 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.703100 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 16:19:36.703159 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.703052 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-69.ec2.internal.18c6807d02910473 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-69.ec2.internal,UID:ip-10-0-134-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-69.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-69.ec2.internal,},FirstTimestamp:2026-07-28 16:19:36.701305971 +0000 UTC m=+0.363615221,LastTimestamp:2026-07-28 16:19:36.701305971 +0000 UTC m=+0.363615221,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-69.ec2.internal,}" Jul 28 16:19:36.703768 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.703753 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w26wj" Jul 28 16:19:36.704498 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.704484 2549 policy_none.go:47] "Start" Jul 28 16:19:36.713487 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.713382 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w26wj" Jul 28 16:19:36.715055 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.714972 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-69.ec2.internal.18c6807d0291416b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-69.ec2.internal,UID:ip-10-0-134-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-69.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-69.ec2.internal,},FirstTimestamp:2026-07-28 16:19:36.701321579 +0000 UTC m=+0.363630825,LastTimestamp:2026-07-28 16:19:36.701321579 +0000 UTC m=+0.363630825,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-69.ec2.internal,}" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.735009 2549 manager.go:337] "Starting Device Plugin manager" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.735032 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.735041 2549 server.go:87] "Starting device plugin registration server" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.735264 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.735275 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.735350 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.735421 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.735431 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.735898 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 16:19:36.751365 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.735932 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:36.777260 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.777240 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 16:19:36.778331 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.778315 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 16:19:36.778397 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.778351 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 16:19:36.778397 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.778373 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 16:19:36.778476 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.778407 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 16:19:36.780866 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.780849 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:19:36.835987 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.835963 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:19:36.836847 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.836827 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:19:36.836934 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.836854 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:19:36.836934 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.836863 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:19:36.836934 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.836880 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-69.ec2.internal" Jul 28 16:19:36.849612 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.849597 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-69.ec2.internal" Jul 28 16:19:36.849693 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.849616 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-69.ec2.internal\": node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:36.870064 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.870018 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:36.879036 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.879016 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal"] Jul 28 16:19:36.879088 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.879077 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:19:36.879761 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.879746 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:19:36.879860 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.879790 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:19:36.879860 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.879809 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:19:36.881369 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.881356 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:19:36.881479 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.881465 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" Jul 28 16:19:36.881524 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.881495 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:19:36.882014 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.881996 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:19:36.882014 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.882012 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:19:36.882151 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.882031 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:19:36.882151 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.882030 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:19:36.882151 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.882056 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:19:36.882151 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.882041 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:19:36.883372 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.883356 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal" Jul 28 16:19:36.883451 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.883387 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:19:36.884017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.884003 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:19:36.884092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.884025 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:19:36.884092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.884039 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:19:36.910351 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.910332 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-69.ec2.internal\" not found" node="ip-10-0-134-69.ec2.internal" Jul 28 16:19:36.914478 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.914463 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-69.ec2.internal\" not found" node="ip-10-0-134-69.ec2.internal" Jul 28 16:19:36.970825 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:36.970795 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:36.981636 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.981612 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e28380000a136ab02263f0353f8827fd-config\") pod \"kube-apiserver-proxy-ip-10-0-134-69.ec2.internal\" (UID: \"e28380000a136ab02263f0353f8827fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal" Jul 28 16:19:36.981745 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.981637 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56e3c35631a0828f1c92bc4b97332c65-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal\" (UID: \"56e3c35631a0828f1c92bc4b97332c65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" Jul 28 16:19:36.981745 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:36.981657 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56e3c35631a0828f1c92bc4b97332c65-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal\" (UID: \"56e3c35631a0828f1c92bc4b97332c65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.071314 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:37.071276 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:37.082644 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.082621 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e28380000a136ab02263f0353f8827fd-config\") pod \"kube-apiserver-proxy-ip-10-0-134-69.ec2.internal\" (UID: \"e28380000a136ab02263f0353f8827fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.082696 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.082647 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56e3c35631a0828f1c92bc4b97332c65-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal\" (UID: \"56e3c35631a0828f1c92bc4b97332c65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.082696 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.082664 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56e3c35631a0828f1c92bc4b97332c65-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal\" (UID: \"56e3c35631a0828f1c92bc4b97332c65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.082760 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.082694 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56e3c35631a0828f1c92bc4b97332c65-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal\" (UID: \"56e3c35631a0828f1c92bc4b97332c65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.082760 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.082710 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e28380000a136ab02263f0353f8827fd-config\") pod \"kube-apiserver-proxy-ip-10-0-134-69.ec2.internal\" (UID: \"e28380000a136ab02263f0353f8827fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.082760 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.082715 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56e3c35631a0828f1c92bc4b97332c65-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal\" (UID: \"56e3c35631a0828f1c92bc4b97332c65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.172100 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:37.172023 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:37.212489 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.212468 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.217890 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.217873 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.272870 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:37.272843 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:37.373383 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:37.373340 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:37.473941 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:37.473879 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:37.574452 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:37.574426 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:37.624969 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.624942 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 16:19:37.625491 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.625120 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 16:19:37.674917 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:37.674895 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:37.718486 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.718462 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 16:14:37 +0000 UTC" deadline="2027-12-25 00:16:00.061614051 +0000 UTC" Jul 28 16:19:37.718593 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.718486 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12343h56m22.343130475s" Jul 28 16:19:37.775743 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:37.775685 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:37.816935 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:37.816907 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28380000a136ab02263f0353f8827fd.slice/crio-68dac0fd490a6758b1afd653a4546eb4c3331dee17cb6a9fb6bb798e3f95db44 WatchSource:0}: Error finding container 68dac0fd490a6758b1afd653a4546eb4c3331dee17cb6a9fb6bb798e3f95db44: Status 404 returned error can't find the container with id 68dac0fd490a6758b1afd653a4546eb4c3331dee17cb6a9fb6bb798e3f95db44 Jul 28 16:19:37.817740 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:37.817719 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e3c35631a0828f1c92bc4b97332c65.slice/crio-d8abcc682c0e67b56a48433c6f60e5c6f25ec95cfb37245731d158659a495081 WatchSource:0}: Error finding container d8abcc682c0e67b56a48433c6f60e5c6f25ec95cfb37245731d158659a495081: Status 404 returned error can't find the container with id d8abcc682c0e67b56a48433c6f60e5c6f25ec95cfb37245731d158659a495081 Jul 28 16:19:37.822264 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.822241 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:19:37.828365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.828340 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:19:37.829299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.829282 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:19:37.829397 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.829317 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:19:37.829397 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.829336 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:19:37.836193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.836171 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:19:37.875912 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:37.875889 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-69.ec2.internal\" not found" Jul 28 16:19:37.876028 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.876013 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:19:37.880840 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.880826 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.895949 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.895931 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 16:19:37.896979 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.896966 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal" Jul 28 16:19:37.909137 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:37.909121 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 16:19:38.284914 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.284891 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:19:38.660566 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.660482 2549 apiserver.go:52] "Watching apiserver" Jul 28 16:19:38.670185 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.669216 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 16:19:38.670185 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.669771 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9rgxh","kube-system/konnectivity-agent-tq5kw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal","openshift-multus/multus-679bj","openshift-multus/multus-additional-cni-plugins-sfjfd","openshift-multus/network-metrics-daemon-h957s","openshift-ovn-kubernetes/ovnkube-node-dxdh4","kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jlxf6","openshift-dns/node-resolver-nlrwd","openshift-image-registry/node-ca-6b6zr","openshift-network-diagnostics/network-check-target-xwcqh","openshift-network-operator/iptables-alerter-4lqbb"] Jul 28 16:19:38.671638 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.671614 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.673066 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.672912 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:38.673066 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.672985 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:38.673935 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.673907 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qdxlk\"" Jul 28 16:19:38.673935 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.673927 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 16:19:38.674057 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.673952 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:19:38.674718 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.674693 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.676387 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.676354 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.677288 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.677265 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 16:19:38.677499 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.677483 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 16:19:38.677696 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.677677 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6dqm2\"" Jul 28 16:19:38.677990 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.677971 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 16:19:38.678319 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.678296 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:19:38.679227 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.679075 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xhgsn\"" Jul 28 16:19:38.679227 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.679149 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 16:19:38.679394 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.679281 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 16:19:38.679536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.679519 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-679bj" Jul 28 16:19:38.680367 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.680349 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 16:19:38.681950 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.681887 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.684819 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.683638 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 16:19:38.684819 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.683827 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8t7pf\"" Jul 28 16:19:38.684819 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.683917 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 16:19:38.684819 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.684075 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 16:19:38.684819 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.684111 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 16:19:38.684819 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.684313 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.684819 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.684456 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 16:19:38.684819 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.684468 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vkrfw\"" Jul 28 16:19:38.685346 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.685329 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 16:19:38.685726 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.685709 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:38.685941 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.685916 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:38.686662 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.686620 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.687050 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.687807 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.688015 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.688057 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.688132 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.688216 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.688272 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v89lc\"" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.688741 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.688824 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.689075 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.689347 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9xckm\"" Jul 28 16:19:38.690756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.689467 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 16:19:38.691502 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.691226 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692586 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-hostroot\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692634 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-sysctl-d\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692664 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-tuned\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692696 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-registration-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-system-cni-dir\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692762 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-cnibin\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692791 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-run-netns\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692817 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-daemon-config\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692884 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4p5h\" (UniqueName: \"kubernetes.io/projected/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-kube-api-access-c4p5h\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692919 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-sysctl-conf\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692948 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-sys\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.692978 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac7c7edc-7aee-4b59-b838-bd95458ccb11-tmp\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693015 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693047 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-sys-fs\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693094 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-run-multus-certs\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693124 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c85ec821-e4dd-46d0-babc-6d359c3b06dd-host-slash\") pod \"iptables-alerter-4lqbb\" (UID: \"c85ec821-e4dd-46d0-babc-6d359c3b06dd\") " pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.693880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693151 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-var-lib-cni-multus\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693186 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-conf-dir\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693216 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-etc-kubernetes\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693248 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-cnibin\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693279 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693318 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgxl\" (UniqueName: \"kubernetes.io/projected/ac7c7edc-7aee-4b59-b838-bd95458ccb11-kube-api-access-rzgxl\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693350 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-run-k8s-cni-cncf-io\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693382 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldq6l\" (UniqueName: \"kubernetes.io/projected/3d121c37-ab34-4006-a089-e7ad58a505a7-kube-api-access-ldq6l\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693415 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-var-lib-kubelet\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693450 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8x4p\" (UniqueName: \"kubernetes.io/projected/c85ec821-e4dd-46d0-babc-6d359c3b06dd-kube-api-access-g8x4p\") pod \"iptables-alerter-4lqbb\" (UID: \"c85ec821-e4dd-46d0-babc-6d359c3b06dd\") " pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693481 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-os-release\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693510 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-socket-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693541 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-system-cni-dir\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693577 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693611 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-modprobe-d\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693641 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-lib-modules\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.694724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-host\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693836 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.693887 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwp7j\" (UniqueName: \"kubernetes.io/projected/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-kube-api-access-jwp7j\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694103 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-os-release\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694318 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-cni-binary-copy\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694353 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694378 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-run\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694410 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-device-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694586 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694619 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c85ec821-e4dd-46d0-babc-6d359c3b06dd-iptables-alerter-script\") pod \"iptables-alerter-4lqbb\" (UID: \"c85ec821-e4dd-46d0-babc-6d359c3b06dd\") " pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694646 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d121c37-ab34-4006-a089-e7ad58a505a7-cni-binary-copy\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694677 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-sysconfig\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694708 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-kubernetes\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694849 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-systemd\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694896 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-cni-dir\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694923 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-socket-dir-parent\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.695364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.694953 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-var-lib-cni-bin\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.696213 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.695052 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-var-lib-kubelet\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.696213 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.695904 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qbwkc\"" Jul 28 16:19:38.696473 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.696422 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 16:19:38.699518 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.699466 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.700887 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.700784 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 16:19:38.700954 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.700909 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 16:19:38.702903 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.702711 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 16:19:38.703021 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.703006 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ft9tf\"" Jul 28 16:19:38.703098 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.703008 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 16:19:38.703323 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.703305 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 16:19:38.721031 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.720987 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m89fj" Jul 28 16:19:38.733163 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.733140 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m89fj" Jul 28 16:19:38.782280 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.782258 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 16:19:38.784548 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.784499 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" event={"ID":"56e3c35631a0828f1c92bc4b97332c65","Type":"ContainerStarted","Data":"d8abcc682c0e67b56a48433c6f60e5c6f25ec95cfb37245731d158659a495081"} Jul 28 16:19:38.786031 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.785982 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal" event={"ID":"e28380000a136ab02263f0353f8827fd","Type":"ContainerStarted","Data":"68dac0fd490a6758b1afd653a4546eb4c3331dee17cb6a9fb6bb798e3f95db44"} Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795541 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-modprobe-d\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795612 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-lib-modules\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795638 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-host\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795666 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c85ec821-e4dd-46d0-babc-6d359c3b06dd-iptables-alerter-script\") pod \"iptables-alerter-4lqbb\" (UID: \"c85ec821-e4dd-46d0-babc-6d359c3b06dd\") " pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795697 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-etc-openvswitch\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795722 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795748 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-hostroot\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795773 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd4zr\" (UniqueName: \"kubernetes.io/projected/9f8166bc-ce1e-4979-b234-66c97b474e89-kube-api-access-jd4zr\") pod \"node-resolver-nlrwd\" (UID: \"9f8166bc-ce1e-4979-b234-66c97b474e89\") " pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795798 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-slash\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.795817 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795824 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-modprobe-d\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795839 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-sysconfig\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795864 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-kubernetes\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795888 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-systemd\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795913 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-cni-dir\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795938 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795971 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b754674c-43ab-4e8d-a7dd-08330fa21b80-host\") pod \"node-ca-6b6zr\" (UID: \"b754674c-43ab-4e8d-a7dd-08330fa21b80\") " pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795987 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-lib-modules\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.795998 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-sysctl-d\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796039 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-registration-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796082 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-var-lib-openvswitch\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796108 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-run-ovn\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796129 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-sysctl-d\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796136 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crv4w\" (UniqueName: \"kubernetes.io/projected/11c6d6da-427f-4f4b-8af3-995e860f1e87-kube-api-access-crv4w\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796163 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-sys\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796184 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-hostroot\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796189 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:38.796466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796215 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-sys-fs\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796265 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-sysconfig\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796289 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-kubelet-config\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796342 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-registration-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796347 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-systemd\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796365 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c85ec821-e4dd-46d0-babc-6d359c3b06dd-host-slash\") pod \"iptables-alerter-4lqbb\" (UID: \"c85ec821-e4dd-46d0-babc-6d359c3b06dd\") " pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796407 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-sys-fs\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796448 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-host\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796493 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-sys\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796509 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-conf-dir\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796529 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-cni-dir\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796545 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-dbus\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796597 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-kubernetes\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796642 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b754674c-43ab-4e8d-a7dd-08330fa21b80-serviceca\") pod \"node-ca-6b6zr\" (UID: \"b754674c-43ab-4e8d-a7dd-08330fa21b80\") " pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796672 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-cnibin\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796700 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796727 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh87c\" (UniqueName: \"kubernetes.io/projected/6f8117b8-9615-4fbd-bd55-ced89f5b2127-kube-api-access-nh87c\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:38.797326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796753 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f8166bc-ce1e-4979-b234-66c97b474e89-hosts-file\") pod \"node-resolver-nlrwd\" (UID: \"9f8166bc-ce1e-4979-b234-66c97b474e89\") " pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796759 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-conf-dir\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796779 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-var-lib-kubelet\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796804 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-cnibin\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796863 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8x4p\" (UniqueName: \"kubernetes.io/projected/c85ec821-e4dd-46d0-babc-6d359c3b06dd-kube-api-access-g8x4p\") pod \"iptables-alerter-4lqbb\" (UID: \"c85ec821-e4dd-46d0-babc-6d359c3b06dd\") " pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796892 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-os-release\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796920 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-log-socket\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796936 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-var-lib-kubelet\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796947 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-socket-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.796947 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c85ec821-e4dd-46d0-babc-6d359c3b06dd-host-slash\") pod \"iptables-alerter-4lqbb\" (UID: \"c85ec821-e4dd-46d0-babc-6d359c3b06dd\") " pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797018 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-os-release\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797065 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-socket-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797085 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-system-cni-dir\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797117 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797164 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-system-cni-dir\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797168 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797250 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.798169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797322 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797335 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwp7j\" (UniqueName: \"kubernetes.io/projected/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-kube-api-access-jwp7j\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797399 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d121c37-ab34-4006-a089-e7ad58a505a7-cni-binary-copy\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797406 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c85ec821-e4dd-46d0-babc-6d359c3b06dd-iptables-alerter-script\") pod \"iptables-alerter-4lqbb\" (UID: \"c85ec821-e4dd-46d0-babc-6d359c3b06dd\") " pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797442 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-run-netns\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797574 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-daemon-config\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797623 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-run-netns\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797647 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797672 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-os-release\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797698 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-cni-binary-copy\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797715 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-run\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797735 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-device-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797760 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797830 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-os-release\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797883 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-socket-dir-parent\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797912 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-var-lib-cni-bin\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797937 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldq6l\" (UniqueName: \"kubernetes.io/projected/3d121c37-ab34-4006-a089-e7ad58a505a7-kube-api-access-ldq6l\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797960 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-var-lib-kubelet\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.797977 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d121c37-ab34-4006-a089-e7ad58a505a7-cni-binary-copy\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798045 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-run\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798049 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-device-dir\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798080 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-etc-kubernetes\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798096 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-socket-dir-parent\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798112 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txntd\" (UniqueName: \"kubernetes.io/projected/b754674c-43ab-4e8d-a7dd-08330fa21b80-kube-api-access-txntd\") pod \"node-ca-6b6zr\" (UID: \"b754674c-43ab-4e8d-a7dd-08330fa21b80\") " pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798123 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d121c37-ab34-4006-a089-e7ad58a505a7-multus-daemon-config\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798138 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-kubelet\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798179 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-var-lib-cni-bin\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798188 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-run-systemd\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798211 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-run-openvswitch\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798238 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-tuned\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798252 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-cni-binary-copy\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798267 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-system-cni-dir\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798269 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798237 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-etc-kubernetes\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798322 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-cnibin\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.799901 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798345 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-var-lib-kubelet\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798351 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2075f47f-bac4-4cc1-aa2f-ae97218e259b-agent-certs\") pod \"konnectivity-agent-tq5kw\" (UID: \"2075f47f-bac4-4cc1-aa2f-ae97218e259b\") " pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798360 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-system-cni-dir\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798386 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-cni-bin\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798398 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-cnibin\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798446 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11c6d6da-427f-4f4b-8af3-995e860f1e87-env-overrides\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798490 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4p5h\" (UniqueName: \"kubernetes.io/projected/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-kube-api-access-c4p5h\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798532 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-sysctl-conf\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798557 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac7c7edc-7aee-4b59-b838-bd95458ccb11-tmp\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798581 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-run-multus-certs\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798606 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2075f47f-bac4-4cc1-aa2f-ae97218e259b-konnectivity-ca\") pod \"konnectivity-agent-tq5kw\" (UID: \"2075f47f-bac4-4cc1-aa2f-ae97218e259b\") " pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798617 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798632 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-run-netns\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798660 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-var-lib-cni-multus\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798687 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-systemd-units\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798689 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-sysctl-conf\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798711 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-node-log\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.800802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798736 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-run-ovn-kubernetes\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798761 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11c6d6da-427f-4f4b-8af3-995e860f1e87-ovn-node-metrics-cert\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798785 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11c6d6da-427f-4f4b-8af3-995e860f1e87-ovnkube-script-lib\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798827 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798873 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgxl\" (UniqueName: \"kubernetes.io/projected/ac7c7edc-7aee-4b59-b838-bd95458ccb11-kube-api-access-rzgxl\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798898 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-run-k8s-cni-cncf-io\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798932 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-cni-netd\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.798971 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-run-multus-certs\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.799046 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-var-lib-cni-multus\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.799062 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d121c37-ab34-4006-a089-e7ad58a505a7-host-run-k8s-cni-cncf-io\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.799095 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.799103 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.799132 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f8166bc-ce1e-4979-b234-66c97b474e89-tmp-dir\") pod \"node-resolver-nlrwd\" (UID: \"9f8166bc-ce1e-4979-b234-66c97b474e89\") " pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.801665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.799167 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11c6d6da-427f-4f4b-8af3-995e860f1e87-ovnkube-config\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.803144 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.803121 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac7c7edc-7aee-4b59-b838-bd95458ccb11-tmp\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.803494 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.803462 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac7c7edc-7aee-4b59-b838-bd95458ccb11-etc-tuned\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.806949 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.806924 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:19:38.807051 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.806953 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:19:38.807051 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.806968 2549 projected.go:196] Error preparing data for projected volume kube-api-access-p7zht for pod openshift-network-diagnostics/network-check-target-xwcqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:38.807051 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.807049 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht podName:4d5726a9-e9bc-499a-8242-029988bfcf79 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:39.3070291 +0000 UTC m=+2.969338336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p7zht" (UniqueName: "kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht") pod "network-check-target-xwcqh" (UID: "4d5726a9-e9bc-499a-8242-029988bfcf79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:38.810003 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.809980 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4p5h\" (UniqueName: \"kubernetes.io/projected/40ddc838-b9e9-4da9-aab9-f897e6fd2d34-kube-api-access-c4p5h\") pod \"multus-additional-cni-plugins-sfjfd\" (UID: \"40ddc838-b9e9-4da9-aab9-f897e6fd2d34\") " pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:38.810456 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.810435 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8x4p\" (UniqueName: \"kubernetes.io/projected/c85ec821-e4dd-46d0-babc-6d359c3b06dd-kube-api-access-g8x4p\") pod \"iptables-alerter-4lqbb\" (UID: \"c85ec821-e4dd-46d0-babc-6d359c3b06dd\") " pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:38.812008 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.811981 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwp7j\" (UniqueName: \"kubernetes.io/projected/a015534d-0d86-40a9-a8f8-5ef9f84bf1b1-kube-api-access-jwp7j\") pod \"aws-ebs-csi-driver-node-9mwcx\" (UID: \"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:38.812506 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.812484 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldq6l\" (UniqueName: \"kubernetes.io/projected/3d121c37-ab34-4006-a089-e7ad58a505a7-kube-api-access-ldq6l\") pod \"multus-679bj\" (UID: \"3d121c37-ab34-4006-a089-e7ad58a505a7\") " pod="openshift-multus/multus-679bj" Jul 28 16:19:38.812595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.812487 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgxl\" (UniqueName: \"kubernetes.io/projected/ac7c7edc-7aee-4b59-b838-bd95458ccb11-kube-api-access-rzgxl\") pod \"tuned-jlxf6\" (UID: \"ac7c7edc-7aee-4b59-b838-bd95458ccb11\") " pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.813676 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.813654 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:19:38.900720 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.900631 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-systemd-units\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.900720 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.900685 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-node-log\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.900720 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.900720 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-run-ovn-kubernetes\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901011 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.900745 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-systemd-units\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901011 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.900749 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11c6d6da-427f-4f4b-8af3-995e860f1e87-ovn-node-metrics-cert\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901011 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.900822 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11c6d6da-427f-4f4b-8af3-995e860f1e87-ovnkube-script-lib\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901011 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.900865 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-cni-netd\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901011 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.900901 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901259 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.901202 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-node-log\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901259 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.901240 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f8166bc-ce1e-4979-b234-66c97b474e89-tmp-dir\") pod \"node-resolver-nlrwd\" (UID: \"9f8166bc-ce1e-4979-b234-66c97b474e89\") " pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.901370 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.901283 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-run-ovn-kubernetes\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901370 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.901298 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-cni-netd\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901370 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.900930 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f8166bc-ce1e-4979-b234-66c97b474e89-tmp-dir\") pod \"node-resolver-nlrwd\" (UID: \"9f8166bc-ce1e-4979-b234-66c97b474e89\") " pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.901524 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.901382 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901927 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.901719 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11c6d6da-427f-4f4b-8af3-995e860f1e87-ovnkube-config\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.901927 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.901890 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-etc-openvswitch\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902095 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.901934 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd4zr\" (UniqueName: \"kubernetes.io/projected/9f8166bc-ce1e-4979-b234-66c97b474e89-kube-api-access-jd4zr\") pod \"node-resolver-nlrwd\" (UID: \"9f8166bc-ce1e-4979-b234-66c97b474e89\") " pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.902095 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.901967 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-slash\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902095 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902033 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11c6d6da-427f-4f4b-8af3-995e860f1e87-ovnkube-script-lib\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902095 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902036 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902096 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b754674c-43ab-4e8d-a7dd-08330fa21b80-host\") pod \"node-ca-6b6zr\" (UID: \"b754674c-43ab-4e8d-a7dd-08330fa21b80\") " pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902087 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-slash\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902112 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-etc-openvswitch\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902136 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-var-lib-openvswitch\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902164 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b754674c-43ab-4e8d-a7dd-08330fa21b80-host\") pod \"node-ca-6b6zr\" (UID: \"b754674c-43ab-4e8d-a7dd-08330fa21b80\") " pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902176 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-run-ovn\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902203 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crv4w\" (UniqueName: \"kubernetes.io/projected/11c6d6da-427f-4f4b-8af3-995e860f1e87-kube-api-access-crv4w\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902256 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-kubelet-config\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.902261 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:38.902299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902290 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-dbus\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902317 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b754674c-43ab-4e8d-a7dd-08330fa21b80-serviceca\") pod \"node-ca-6b6zr\" (UID: \"b754674c-43ab-4e8d-a7dd-08330fa21b80\") " pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902353 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902365 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11c6d6da-427f-4f4b-8af3-995e860f1e87-ovnkube-config\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.902396 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret podName:af39ac3f-cffd-4cdf-8d42-5cecac6c8b62 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:39.402353778 +0000 UTC m=+3.064663032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret") pod "global-pull-secret-syncer-9rgxh" (UID: "af39ac3f-cffd-4cdf-8d42-5cecac6c8b62") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902432 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-dbus\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902454 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh87c\" (UniqueName: \"kubernetes.io/projected/6f8117b8-9615-4fbd-bd55-ced89f5b2127-kube-api-access-nh87c\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902492 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f8166bc-ce1e-4979-b234-66c97b474e89-hosts-file\") pod \"node-resolver-nlrwd\" (UID: \"9f8166bc-ce1e-4979-b234-66c97b474e89\") " pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902525 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-log-socket\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902583 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txntd\" (UniqueName: \"kubernetes.io/projected/b754674c-43ab-4e8d-a7dd-08330fa21b80-kube-api-access-txntd\") pod \"node-ca-6b6zr\" (UID: \"b754674c-43ab-4e8d-a7dd-08330fa21b80\") " pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902615 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-kubelet\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902642 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-run-systemd\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902656 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-run-ovn\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902675 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-run-openvswitch\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902712 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2075f47f-bac4-4cc1-aa2f-ae97218e259b-agent-certs\") pod \"konnectivity-agent-tq5kw\" (UID: \"2075f47f-bac4-4cc1-aa2f-ae97218e259b\") " pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:19:38.902778 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902744 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-cni-bin\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902817 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-run-systemd\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902831 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11c6d6da-427f-4f4b-8af3-995e860f1e87-env-overrides\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902881 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2075f47f-bac4-4cc1-aa2f-ae97218e259b-konnectivity-ca\") pod \"konnectivity-agent-tq5kw\" (UID: \"2075f47f-bac4-4cc1-aa2f-ae97218e259b\") " pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902892 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b754674c-43ab-4e8d-a7dd-08330fa21b80-serviceca\") pod \"node-ca-6b6zr\" (UID: \"b754674c-43ab-4e8d-a7dd-08330fa21b80\") " pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902912 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-kubelet\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902938 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-run-netns\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.903008 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-cni-bin\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.902615 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-var-lib-openvswitch\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.903056 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-host-run-netns\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.903248 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-log-socket\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.903270 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.903310 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11c6d6da-427f-4f4b-8af3-995e860f1e87-run-openvswitch\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:38.903336 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs podName:6f8117b8-9615-4fbd-bd55-ced89f5b2127 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:39.403307839 +0000 UTC m=+3.065617093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs") pod "network-metrics-daemon-h957s" (UID: "6f8117b8-9615-4fbd-bd55-ced89f5b2127") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.903520 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f8166bc-ce1e-4979-b234-66c97b474e89-hosts-file\") pod \"node-resolver-nlrwd\" (UID: \"9f8166bc-ce1e-4979-b234-66c97b474e89\") " pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.903536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.903524 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2075f47f-bac4-4cc1-aa2f-ae97218e259b-konnectivity-ca\") pod \"konnectivity-agent-tq5kw\" (UID: \"2075f47f-bac4-4cc1-aa2f-ae97218e259b\") " pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:19:38.904331 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.903781 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11c6d6da-427f-4f4b-8af3-995e860f1e87-env-overrides\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.904443 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.904418 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-kubelet-config\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:38.904597 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.904568 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11c6d6da-427f-4f4b-8af3-995e860f1e87-ovn-node-metrics-cert\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.905988 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.905965 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2075f47f-bac4-4cc1-aa2f-ae97218e259b-agent-certs\") pod \"konnectivity-agent-tq5kw\" (UID: \"2075f47f-bac4-4cc1-aa2f-ae97218e259b\") " pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:19:38.916345 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.916283 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crv4w\" (UniqueName: \"kubernetes.io/projected/11c6d6da-427f-4f4b-8af3-995e860f1e87-kube-api-access-crv4w\") pod \"ovnkube-node-dxdh4\" (UID: \"11c6d6da-427f-4f4b-8af3-995e860f1e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:38.920678 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.920623 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd4zr\" (UniqueName: \"kubernetes.io/projected/9f8166bc-ce1e-4979-b234-66c97b474e89-kube-api-access-jd4zr\") pod \"node-resolver-nlrwd\" (UID: \"9f8166bc-ce1e-4979-b234-66c97b474e89\") " pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:38.920678 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.920636 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txntd\" (UniqueName: \"kubernetes.io/projected/b754674c-43ab-4e8d-a7dd-08330fa21b80-kube-api-access-txntd\") pod \"node-ca-6b6zr\" (UID: \"b754674c-43ab-4e8d-a7dd-08330fa21b80\") " pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:38.921038 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.921021 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh87c\" (UniqueName: \"kubernetes.io/projected/6f8117b8-9615-4fbd-bd55-ced89f5b2127-kube-api-access-nh87c\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:38.986005 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.985977 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" Jul 28 16:19:38.995699 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:38.995676 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" Jul 28 16:19:39.006937 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.006912 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4lqbb" Jul 28 16:19:39.015133 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.015083 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-679bj" Jul 28 16:19:39.024903 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.024882 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" Jul 28 16:19:39.032042 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.032025 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:19:39.040409 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.040367 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:19:39.048634 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.048615 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nlrwd" Jul 28 16:19:39.056502 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.056474 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6b6zr" Jul 28 16:19:39.407755 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.407676 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:39.407755 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.407724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:39.408008 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.407849 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:39.408008 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.407862 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:19:39.408008 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.407876 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:19:39.408008 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.407885 2549 projected.go:196] Error preparing data for projected volume kube-api-access-p7zht for pod openshift-network-diagnostics/network-check-target-xwcqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:39.408008 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.407906 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret podName:af39ac3f-cffd-4cdf-8d42-5cecac6c8b62 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:40.407890006 +0000 UTC m=+4.070199241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret") pod "global-pull-secret-syncer-9rgxh" (UID: "af39ac3f-cffd-4cdf-8d42-5cecac6c8b62") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:39.408008 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.407843 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:39.408008 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.407919 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:39.408008 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.407936 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht podName:4d5726a9-e9bc-499a-8242-029988bfcf79 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:40.407919694 +0000 UTC m=+4.070228931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7zht" (UniqueName: "kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht") pod "network-check-target-xwcqh" (UID: "4d5726a9-e9bc-499a-8242-029988bfcf79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:39.408008 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.407988 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs podName:6f8117b8-9615-4fbd-bd55-ced89f5b2127 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:40.407972298 +0000 UTC m=+4.070281536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs") pod "network-metrics-daemon-h957s" (UID: "6f8117b8-9615-4fbd-bd55-ced89f5b2127") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:39.736188 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.736094 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 16:14:39 +0000 UTC" deadline="2028-01-04 21:22:15.078787462 +0000 UTC" Jul 28 16:19:39.736188 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.736130 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12605h2m35.342661082s" Jul 28 16:19:39.779541 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.779509 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:39.779541 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:39.779530 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:39.779708 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.779651 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:39.779815 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:39.779770 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:39.908443 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:39.908406 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d121c37_ab34_4006_a089_e7ad58a505a7.slice/crio-b1e74e748c5919ffd399d4c097c368e4a3a0a8c948f43f25696525b29eccdc7c WatchSource:0}: Error finding container b1e74e748c5919ffd399d4c097c368e4a3a0a8c948f43f25696525b29eccdc7c: Status 404 returned error can't find the container with id b1e74e748c5919ffd399d4c097c368e4a3a0a8c948f43f25696525b29eccdc7c Jul 28 16:19:39.927296 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:39.927268 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7c7edc_7aee_4b59_b838_bd95458ccb11.slice/crio-4906e27710a7ab310530402e91c53791189bc41b098fde70ec7674b52b500190 WatchSource:0}: Error finding container 4906e27710a7ab310530402e91c53791189bc41b098fde70ec7674b52b500190: Status 404 returned error can't find the container with id 4906e27710a7ab310530402e91c53791189bc41b098fde70ec7674b52b500190 Jul 28 16:19:39.928202 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:39.928176 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ddc838_b9e9_4da9_aab9_f897e6fd2d34.slice/crio-3c2464ac50e8889f737bd03038d755d71c20bacd6786fe6b379dbf4c0e747276 WatchSource:0}: Error finding container 3c2464ac50e8889f737bd03038d755d71c20bacd6786fe6b379dbf4c0e747276: Status 404 returned error can't find the container with id 3c2464ac50e8889f737bd03038d755d71c20bacd6786fe6b379dbf4c0e747276 Jul 28 16:19:39.929318 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:39.929299 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85ec821_e4dd_46d0_babc_6d359c3b06dd.slice/crio-4396d4d3c8f59dd074db7eed5c3175226967133e5fb5d39324eda23af1ecc6d2 WatchSource:0}: Error finding container 4396d4d3c8f59dd074db7eed5c3175226967133e5fb5d39324eda23af1ecc6d2: Status 404 returned error can't find the container with id 4396d4d3c8f59dd074db7eed5c3175226967133e5fb5d39324eda23af1ecc6d2 Jul 28 16:19:39.931231 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:39.931038 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8166bc_ce1e_4979_b234_66c97b474e89.slice/crio-84aa1834c160ce738490cb5e81d5eefe415b93d90e05a2cc4a3cbc3259055fa4 WatchSource:0}: Error finding container 84aa1834c160ce738490cb5e81d5eefe415b93d90e05a2cc4a3cbc3259055fa4: Status 404 returned error can't find the container with id 84aa1834c160ce738490cb5e81d5eefe415b93d90e05a2cc4a3cbc3259055fa4 Jul 28 16:19:39.931905 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:39.931777 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb754674c_43ab_4e8d_a7dd_08330fa21b80.slice/crio-d7ca652a01bff85832a31ae80b8227cd51d5831310d21b2fd70c58224501b7c7 WatchSource:0}: Error finding container d7ca652a01bff85832a31ae80b8227cd51d5831310d21b2fd70c58224501b7c7: Status 404 returned error can't find the container with id d7ca652a01bff85832a31ae80b8227cd51d5831310d21b2fd70c58224501b7c7 Jul 28 16:19:39.932908 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:39.932693 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2075f47f_bac4_4cc1_aa2f_ae97218e259b.slice/crio-f696b1f4e3449b58fa48d4e9ad4617915cb2acf44bda677b8e93eb947dd25b7b WatchSource:0}: Error finding container f696b1f4e3449b58fa48d4e9ad4617915cb2acf44bda677b8e93eb947dd25b7b: Status 404 returned error can't find the container with id f696b1f4e3449b58fa48d4e9ad4617915cb2acf44bda677b8e93eb947dd25b7b Jul 28 16:19:39.934424 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:39.934383 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda015534d_0d86_40a9_a8f8_5ef9f84bf1b1.slice/crio-05992d9d0e81347b6d92bb24c964e0753a4e560f7636e1fe72bf10f1a0a8bec0 WatchSource:0}: Error finding container 05992d9d0e81347b6d92bb24c964e0753a4e560f7636e1fe72bf10f1a0a8bec0: Status 404 returned error can't find the container with id 05992d9d0e81347b6d92bb24c964e0753a4e560f7636e1fe72bf10f1a0a8bec0 Jul 28 16:19:39.936442 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:19:39.935920 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c6d6da_427f_4f4b_8af3_995e860f1e87.slice/crio-9976bf53255d5f97d9992635386f355d5102fe39a5ba7a00d7089739777da61b WatchSource:0}: Error finding container 9976bf53255d5f97d9992635386f355d5102fe39a5ba7a00d7089739777da61b: Status 404 returned error can't find the container with id 9976bf53255d5f97d9992635386f355d5102fe39a5ba7a00d7089739777da61b Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.415155 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:40.415402 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:40.415465 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.415449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:40.415484 2549 projected.go:196] Error preparing data for projected volume kube-api-access-p7zht for pod openshift-network-diagnostics/network-check-target-xwcqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:40.415554 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht podName:4d5726a9-e9bc-499a-8242-029988bfcf79 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:42.415531089 +0000 UTC m=+6.077840343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7zht" (UniqueName: "kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht") pod "network-check-target-xwcqh" (UID: "4d5726a9-e9bc-499a-8242-029988bfcf79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.415607 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:40.415616 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:40.415669 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs podName:6f8117b8-9615-4fbd-bd55-ced89f5b2127 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:42.41565281 +0000 UTC m=+6.077962062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs") pod "network-metrics-daemon-h957s" (UID: "6f8117b8-9615-4fbd-bd55-ced89f5b2127") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:40.415704 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:40.415795 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:40.415744 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret podName:af39ac3f-cffd-4cdf-8d42-5cecac6c8b62 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:42.415730881 +0000 UTC m=+6.078040121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret") pod "global-pull-secret-syncer-9rgxh" (UID: "af39ac3f-cffd-4cdf-8d42-5cecac6c8b62") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:40.737086 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.736954 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 16:14:39 +0000 UTC" deadline="2028-03-16 04:42:16.519542874 +0000 UTC" Jul 28 16:19:40.737086 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.736999 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14316h22m35.782548853s" Jul 28 16:19:40.779867 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.779293 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:40.779867 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:40.779464 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:40.803739 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.803661 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tq5kw" event={"ID":"2075f47f-bac4-4cc1-aa2f-ae97218e259b","Type":"ContainerStarted","Data":"f696b1f4e3449b58fa48d4e9ad4617915cb2acf44bda677b8e93eb947dd25b7b"} Jul 28 16:19:40.814990 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.814898 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6b6zr" event={"ID":"b754674c-43ab-4e8d-a7dd-08330fa21b80","Type":"ContainerStarted","Data":"d7ca652a01bff85832a31ae80b8227cd51d5831310d21b2fd70c58224501b7c7"} Jul 28 16:19:40.826570 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.826529 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4lqbb" event={"ID":"c85ec821-e4dd-46d0-babc-6d359c3b06dd","Type":"ContainerStarted","Data":"4396d4d3c8f59dd074db7eed5c3175226967133e5fb5d39324eda23af1ecc6d2"} Jul 28 16:19:40.837731 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.837692 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" event={"ID":"ac7c7edc-7aee-4b59-b838-bd95458ccb11","Type":"ContainerStarted","Data":"4906e27710a7ab310530402e91c53791189bc41b098fde70ec7674b52b500190"} Jul 28 16:19:40.846152 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.846081 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nlrwd" event={"ID":"9f8166bc-ce1e-4979-b234-66c97b474e89","Type":"ContainerStarted","Data":"84aa1834c160ce738490cb5e81d5eefe415b93d90e05a2cc4a3cbc3259055fa4"} Jul 28 16:19:40.850127 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.850056 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" event={"ID":"40ddc838-b9e9-4da9-aab9-f897e6fd2d34","Type":"ContainerStarted","Data":"3c2464ac50e8889f737bd03038d755d71c20bacd6786fe6b379dbf4c0e747276"} Jul 28 16:19:40.867080 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.867006 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-679bj" event={"ID":"3d121c37-ab34-4006-a089-e7ad58a505a7","Type":"ContainerStarted","Data":"b1e74e748c5919ffd399d4c097c368e4a3a0a8c948f43f25696525b29eccdc7c"} Jul 28 16:19:40.896969 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.896931 2549 generic.go:356] "Generic (PLEG): container finished" podID="56e3c35631a0828f1c92bc4b97332c65" containerID="5db37476e8768cf068884d9dbcea6c87b6de90eb1eb05078a58877cfb41e2104" exitCode=0 Jul 28 16:19:40.897837 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.897804 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" event={"ID":"56e3c35631a0828f1c92bc4b97332c65","Type":"ContainerDied","Data":"5db37476e8768cf068884d9dbcea6c87b6de90eb1eb05078a58877cfb41e2104"} Jul 28 16:19:40.907374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.907348 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal" event={"ID":"e28380000a136ab02263f0353f8827fd","Type":"ContainerStarted","Data":"c3f90a39ccc15278048a4e525bc77b5e61ea4b49a3689546a9aaa7a8902321db"} Jul 28 16:19:40.921858 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.921756 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" event={"ID":"11c6d6da-427f-4f4b-8af3-995e860f1e87","Type":"ContainerStarted","Data":"9976bf53255d5f97d9992635386f355d5102fe39a5ba7a00d7089739777da61b"} Jul 28 16:19:40.933180 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.933125 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" event={"ID":"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1","Type":"ContainerStarted","Data":"05992d9d0e81347b6d92bb24c964e0753a4e560f7636e1fe72bf10f1a0a8bec0"} Jul 28 16:19:40.936363 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:40.936119 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-69.ec2.internal" podStartSLOduration=2.936100921 podStartE2EDuration="2.936100921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:19:40.93531884 +0000 UTC m=+4.597628101" watchObservedRunningTime="2026-07-28 16:19:40.936100921 +0000 UTC m=+4.598410181" Jul 28 16:19:41.780405 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:41.779529 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:41.780405 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:41.779689 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:41.780405 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:41.780206 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:41.780405 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:41.780307 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:41.941962 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:41.941922 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" event={"ID":"56e3c35631a0828f1c92bc4b97332c65","Type":"ContainerStarted","Data":"38a747e248f57d3e69961b7ba0cc7b6f1613514ba09fb35e369f0d65df5f8f32"} Jul 28 16:19:42.434011 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:42.433972 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:42.434319 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:42.434030 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:42.434319 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:42.434112 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:42.434319 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:42.434252 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:42.434485 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:42.434323 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret podName:af39ac3f-cffd-4cdf-8d42-5cecac6c8b62 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:46.434303354 +0000 UTC m=+10.096612596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret") pod "global-pull-secret-syncer-9rgxh" (UID: "af39ac3f-cffd-4cdf-8d42-5cecac6c8b62") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:42.435123 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:42.434811 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:19:42.435123 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:42.434836 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:19:42.435123 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:42.434850 2549 projected.go:196] Error preparing data for projected volume kube-api-access-p7zht for pod openshift-network-diagnostics/network-check-target-xwcqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:42.435123 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:42.434922 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht podName:4d5726a9-e9bc-499a-8242-029988bfcf79 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:46.434905065 +0000 UTC m=+10.097214304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7zht" (UniqueName: "kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht") pod "network-check-target-xwcqh" (UID: "4d5726a9-e9bc-499a-8242-029988bfcf79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:42.435123 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:42.435019 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:42.435123 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:42.435081 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs podName:6f8117b8-9615-4fbd-bd55-ced89f5b2127 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:46.435063557 +0000 UTC m=+10.097372799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs") pod "network-metrics-daemon-h957s" (UID: "6f8117b8-9615-4fbd-bd55-ced89f5b2127") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:42.783799 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:42.783702 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:42.784444 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:42.783837 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:43.779441 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:43.779194 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:43.779441 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:43.779348 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:43.779698 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:43.779451 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:43.779698 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:43.779594 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:44.779913 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:44.779875 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:44.780374 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:44.780021 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:45.779386 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:45.779283 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:45.779386 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:45.779303 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:45.779600 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:45.779425 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:45.779888 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:45.779856 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:46.474512 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:46.474475 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:46.474961 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:46.474525 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:46.474961 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:46.474584 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:46.474961 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:46.474706 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:46.474961 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:46.474765 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs podName:6f8117b8-9615-4fbd-bd55-ced89f5b2127 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:54.474746673 +0000 UTC m=+18.137055913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs") pod "network-metrics-daemon-h957s" (UID: "6f8117b8-9615-4fbd-bd55-ced89f5b2127") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:46.474961 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:46.474845 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:19:46.474961 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:46.474870 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:19:46.474961 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:46.474885 2549 projected.go:196] Error preparing data for projected volume kube-api-access-p7zht for pod openshift-network-diagnostics/network-check-target-xwcqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:46.474961 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:46.474936 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht podName:4d5726a9-e9bc-499a-8242-029988bfcf79 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:54.474920551 +0000 UTC m=+18.137229792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7zht" (UniqueName: "kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht") pod "network-check-target-xwcqh" (UID: "4d5726a9-e9bc-499a-8242-029988bfcf79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:46.475394 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:46.474996 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:46.475394 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:46.475033 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret podName:af39ac3f-cffd-4cdf-8d42-5cecac6c8b62 nodeName:}" failed. No retries permitted until 2026-07-28 16:19:54.475021008 +0000 UTC m=+18.137330267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret") pod "global-pull-secret-syncer-9rgxh" (UID: "af39ac3f-cffd-4cdf-8d42-5cecac6c8b62") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:46.779853 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:46.779572 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:46.779853 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:46.779678 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:47.779456 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:47.779418 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:47.779963 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:47.779502 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:47.779963 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:47.779638 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:47.780082 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:47.779954 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:48.779756 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:48.779724 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:48.780226 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:48.779867 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:49.779026 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:49.778986 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:49.779214 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:49.778995 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:49.779214 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:49.779131 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:49.779320 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:49.779215 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:50.779620 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:50.779590 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:50.779944 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:50.779682 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:51.779306 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:51.779274 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:51.779488 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:51.779279 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:51.779488 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:51.779389 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:51.779577 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:51.779487 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:52.779153 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:52.779125 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:52.779562 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:52.779230 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:53.778911 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:53.778881 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:53.779123 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:53.778882 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:53.779123 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:53.779002 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:53.779123 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:53.779084 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:54.536215 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:54.536179 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:54.536409 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:54.536234 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:54.536409 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:54.536263 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:54.536409 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:54.536348 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:54.536409 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:54.536373 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:54.536602 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:54.536420 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret podName:af39ac3f-cffd-4cdf-8d42-5cecac6c8b62 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:10.536398626 +0000 UTC m=+34.198707896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret") pod "global-pull-secret-syncer-9rgxh" (UID: "af39ac3f-cffd-4cdf-8d42-5cecac6c8b62") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:19:54.536602 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:54.536438 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs podName:6f8117b8-9615-4fbd-bd55-ced89f5b2127 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:10.536430887 +0000 UTC m=+34.198740121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs") pod "network-metrics-daemon-h957s" (UID: "6f8117b8-9615-4fbd-bd55-ced89f5b2127") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:19:54.536602 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:54.536475 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:19:54.536602 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:54.536490 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:19:54.536602 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:54.536501 2549 projected.go:196] Error preparing data for projected volume kube-api-access-p7zht for pod openshift-network-diagnostics/network-check-target-xwcqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:54.536602 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:54.536544 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht podName:4d5726a9-e9bc-499a-8242-029988bfcf79 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:10.536530421 +0000 UTC m=+34.198839673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7zht" (UniqueName: "kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht") pod "network-check-target-xwcqh" (UID: "4d5726a9-e9bc-499a-8242-029988bfcf79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:19:54.779640 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:54.779608 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:54.780016 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:54.779727 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:55.779339 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:55.779307 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:55.779339 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:55.779339 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:55.779566 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:55.779439 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:55.779612 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:55.779573 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:56.780101 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:56.780068 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:56.780548 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:56.780170 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:57.779484 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:57.779450 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:57.779647 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:57.779573 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:57.779647 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:57.779624 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:57.779765 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:57.779732 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:58.781983 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.781832 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:19:58.782490 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:58.782049 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:19:58.973842 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.973813 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-679bj" event={"ID":"3d121c37-ab34-4006-a089-e7ad58a505a7","Type":"ContainerStarted","Data":"92bc62d368caf3bc2d622d4f6a384cedceb1585f4c1bf1212c5d6ab6c234eada"} Jul 28 16:19:58.976664 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.976640 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" event={"ID":"11c6d6da-427f-4f4b-8af3-995e860f1e87","Type":"ContainerStarted","Data":"ac6709adbc4aee6f1352defa2234bd4e461b009e35f43e6645030051f7524165"} Jul 28 16:19:58.976765 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.976715 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" event={"ID":"11c6d6da-427f-4f4b-8af3-995e860f1e87","Type":"ContainerStarted","Data":"233f40e4c87db33eafa02ad9623af25bc90c28d381bf0be6a8496475a30690c1"} Jul 28 16:19:58.976853 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.976768 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" event={"ID":"11c6d6da-427f-4f4b-8af3-995e860f1e87","Type":"ContainerStarted","Data":"94bb36b7eac1849f93289902339c193afa8cbe42f1b99687982989b21da11cc2"} Jul 28 16:19:58.976853 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.976838 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" event={"ID":"11c6d6da-427f-4f4b-8af3-995e860f1e87","Type":"ContainerStarted","Data":"b7a5327207d70a1cd94775c6b3049c362f67b9c3d2376a39f8e62dee5545bdee"} Jul 28 16:19:58.976959 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.976890 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" event={"ID":"11c6d6da-427f-4f4b-8af3-995e860f1e87","Type":"ContainerStarted","Data":"612f0eb19cb6ae41e9963b930db85c19a838bd71e5e0ffedca9a9eb94402b968"} Jul 28 16:19:58.976959 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.976937 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" event={"ID":"11c6d6da-427f-4f4b-8af3-995e860f1e87","Type":"ContainerStarted","Data":"af7c5f0ef34af9d8e5339e0ee44cb4fb8199233d0dd214735dab17e93c841b63"} Jul 28 16:19:58.978109 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.978086 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" event={"ID":"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1","Type":"ContainerStarted","Data":"489450f08d00ec3a34994eb0eedb9e50075084f501056d19f3ee19e3e38eaa09"} Jul 28 16:19:58.979435 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.979410 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tq5kw" event={"ID":"2075f47f-bac4-4cc1-aa2f-ae97218e259b","Type":"ContainerStarted","Data":"529195435f9b5f63f6f45c2810758b03fc2b8cb46381ff1f0ae20b47ab153169"} Jul 28 16:19:58.980664 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.980642 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6b6zr" event={"ID":"b754674c-43ab-4e8d-a7dd-08330fa21b80","Type":"ContainerStarted","Data":"476dd5c019bf8dd90e08f9d0c1acd3aa837124f33bd4ee5dfdf03dfc1695976b"} Jul 28 16:19:58.982044 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.982022 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" event={"ID":"ac7c7edc-7aee-4b59-b838-bd95458ccb11","Type":"ContainerStarted","Data":"d12baee33092f86f564b81a1918fdc7c41533e76aabdaa37f7a5b4b59f90611c"} Jul 28 16:19:58.983301 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.983281 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nlrwd" event={"ID":"9f8166bc-ce1e-4979-b234-66c97b474e89","Type":"ContainerStarted","Data":"8cdc72511d6cd2627215672ece05bfbe611ee461702dda9bb06c90d0d415d374"} Jul 28 16:19:58.984593 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.984569 2549 generic.go:356] "Generic (PLEG): container finished" podID="40ddc838-b9e9-4da9-aab9-f897e6fd2d34" containerID="2c62fa0054358d11c0803d19dd064c48f4c99359e8181e955c98365677aa78fa" exitCode=0 Jul 28 16:19:58.984666 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.984602 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" event={"ID":"40ddc838-b9e9-4da9-aab9-f897e6fd2d34","Type":"ContainerDied","Data":"2c62fa0054358d11c0803d19dd064c48f4c99359e8181e955c98365677aa78fa"} Jul 28 16:19:58.995925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.995890 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-69.ec2.internal" podStartSLOduration=20.995879483 podStartE2EDuration="20.995879483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:19:41.960777674 +0000 UTC m=+5.623086933" watchObservedRunningTime="2026-07-28 16:19:58.995879483 +0000 UTC m=+22.658188739" Jul 28 16:19:58.996037 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:58.995964 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-679bj" podStartSLOduration=3.5991141989999997 podStartE2EDuration="21.995957752s" totalImagesPullingTime="18.396843553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:19:58.995679518 +0000 UTC m=+22.657988773" watchObservedRunningTime="2026-07-28 16:19:58.995957752 +0000 UTC m=+22.658267008" Jul 28 16:19:59.039249 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:59.039193 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jlxf6" podStartSLOduration=3.701332913 podStartE2EDuration="22.039181733s" totalImagesPullingTime="18.33784882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:19:59.017364305 +0000 UTC m=+22.679673561" watchObservedRunningTime="2026-07-28 16:19:59.039181733 +0000 UTC m=+22.701490986" Jul 28 16:19:59.039346 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:59.039299 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nlrwd" podStartSLOduration=3.7268362809999998 podStartE2EDuration="22.039293199s" totalImagesPullingTime="18.312456918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:19:59.038044247 +0000 UTC m=+22.700353502" watchObservedRunningTime="2026-07-28 16:19:59.039293199 +0000 UTC m=+22.701602454" Jul 28 16:19:59.100665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:59.100629 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6b6zr" podStartSLOduration=3.78644213 podStartE2EDuration="22.10061706s" totalImagesPullingTime="18.31417493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:19:59.060666475 +0000 UTC m=+22.722975744" watchObservedRunningTime="2026-07-28 16:19:59.10061706 +0000 UTC m=+22.762926360" Jul 28 16:19:59.122574 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:59.122539 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tq5kw" podStartSLOduration=3.81031172 podStartE2EDuration="22.122527502s" totalImagesPullingTime="18.312215782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:19:59.122223329 +0000 UTC m=+22.784532585" watchObservedRunningTime="2026-07-28 16:19:59.122527502 +0000 UTC m=+22.784836757" Jul 28 16:19:59.779025 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:59.778953 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:19:59.779025 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:59.778996 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:19:59.779296 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:59.779084 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:19:59.779296 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:19:59.779184 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:19:59.988396 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:19:59.988363 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4lqbb" event={"ID":"c85ec821-e4dd-46d0-babc-6d359c3b06dd","Type":"ContainerStarted","Data":"b371da317d0601c2077f10ec5c93e37e63d71957437b26ce79966ad9837e1e11"} Jul 28 16:20:00.006022 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:00.005876 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4lqbb" podStartSLOduration=4.689185526 podStartE2EDuration="23.005856095s" totalImagesPullingTime="18.316670569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:20:00.005392456 +0000 UTC m=+23.667701712" watchObservedRunningTime="2026-07-28 16:20:00.005856095 +0000 UTC m=+23.668165351" Jul 28 16:20:00.075996 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:00.075958 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 16:20:00.748738 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:00.748626 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T16:20:00.075974657Z","UUID":"393e6e05-4e16-4af9-8c20-2915469f6c15","Handler":null,"Name":"","Endpoint":""} Jul 28 16:20:00.750053 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:00.750036 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 16:20:00.750191 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:00.750073 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 16:20:00.782307 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:00.782196 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:00.782432 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:00.782321 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:20:00.993131 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:00.993090 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" event={"ID":"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1","Type":"ContainerStarted","Data":"cfc2a279d178d485b7a7f4c70726543aa936a29df80928f2b7da640e631f1f19"} Jul 28 16:20:01.779059 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:01.778836 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:20:01.779297 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:01.778852 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:01.779297 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:01.779103 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:20:01.779297 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:01.779184 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:20:01.999362 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:01.999327 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" event={"ID":"11c6d6da-427f-4f4b-8af3-995e860f1e87","Type":"ContainerStarted","Data":"109ac213abb15a794ea20cbd7c88825986ef6194211e133b73f5dd97d5fa41c4"} Jul 28 16:20:02.001751 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:02.001722 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" event={"ID":"a015534d-0d86-40a9-a8f8-5ef9f84bf1b1","Type":"ContainerStarted","Data":"09a96f21e9668bda46c23ace997c8ac344825ec0dbb336224a89c848a4e46f61"} Jul 28 16:20:02.020611 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:02.020562 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mwcx" podStartSLOduration=4.051912303 podStartE2EDuration="25.020548126s" totalImagesPullingTime="20.968635823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:20:02.020473497 +0000 UTC m=+25.682782753" watchObservedRunningTime="2026-07-28 16:20:02.020548126 +0000 UTC m=+25.682857382" Jul 28 16:20:02.778646 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:02.778618 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:02.778848 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:02.778738 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:20:03.641171 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:03.640953 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:20:03.641856 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:03.641533 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:20:03.778841 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:03.778816 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:03.778972 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:03.778899 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:20:03.778972 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:03.778825 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:20:03.778972 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:03.778966 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:20:04.009286 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.009222 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" event={"ID":"11c6d6da-427f-4f4b-8af3-995e860f1e87","Type":"ContainerStarted","Data":"74091aa69a0700375b4d4d0279a0c3c418f824e413bf9d35109298d5a20b526b"} Jul 28 16:20:04.009502 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.009479 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:20:04.009574 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.009561 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:20:04.009642 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.009614 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:20:04.011179 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.011153 2549 generic.go:356] "Generic (PLEG): container finished" podID="40ddc838-b9e9-4da9-aab9-f897e6fd2d34" containerID="4a283a8c03b5d8cf6dabb0c4cc906a84defb7b8eb53c4ee4c5e1a56ae8cc4fdd" exitCode=0 Jul 28 16:20:04.011286 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.011223 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" event={"ID":"40ddc838-b9e9-4da9-aab9-f897e6fd2d34","Type":"ContainerDied","Data":"4a283a8c03b5d8cf6dabb0c4cc906a84defb7b8eb53c4ee4c5e1a56ae8cc4fdd"} Jul 28 16:20:04.011484 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.011466 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:20:04.012386 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.011935 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tq5kw" Jul 28 16:20:04.025474 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.025454 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:20:04.025805 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.025773 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:20:04.041860 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.041821 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" podStartSLOduration=8.66503447 podStartE2EDuration="27.041809222s" totalImagesPullingTime="18.376774752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:20:04.040490859 +0000 UTC m=+27.702800114" watchObservedRunningTime="2026-07-28 16:20:04.041809222 +0000 UTC m=+27.704118474" Jul 28 16:20:04.778729 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:04.778702 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:04.779193 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:04.778846 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:20:05.295143 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:05.295120 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9rgxh"] Jul 28 16:20:05.295297 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:05.295230 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:05.295376 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:05.295347 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:20:05.298803 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:05.296639 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xwcqh"] Jul 28 16:20:05.298803 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:05.296849 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:05.298803 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:05.296960 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:20:05.298803 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:05.298757 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h957s"] Jul 28 16:20:05.300009 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:05.299886 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:20:05.300088 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:05.300067 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:20:06.018016 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:06.017811 2549 generic.go:356] "Generic (PLEG): container finished" podID="40ddc838-b9e9-4da9-aab9-f897e6fd2d34" containerID="9f64aa3ae7c20ad60b8338036d82b38e90b04d568bfd10ea0f90707592577ef7" exitCode=0 Jul 28 16:20:06.018473 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:06.017905 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" event={"ID":"40ddc838-b9e9-4da9-aab9-f897e6fd2d34","Type":"ContainerDied","Data":"9f64aa3ae7c20ad60b8338036d82b38e90b04d568bfd10ea0f90707592577ef7"} Jul 28 16:20:06.780754 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:06.780716 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:20:06.780968 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:06.780832 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:06.780968 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:06.780861 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:20:06.780968 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:06.780910 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:20:06.780968 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:06.780936 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:06.781194 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:06.781043 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:20:08.025422 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:08.025380 2549 generic.go:356] "Generic (PLEG): container finished" podID="40ddc838-b9e9-4da9-aab9-f897e6fd2d34" containerID="a14c420a2f5da5cebc109eb693bde29e3c4705aeed04167b755eb8c3cea05a66" exitCode=0 Jul 28 16:20:08.026104 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:08.025438 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" event={"ID":"40ddc838-b9e9-4da9-aab9-f897e6fd2d34","Type":"ContainerDied","Data":"a14c420a2f5da5cebc109eb693bde29e3c4705aeed04167b755eb8c3cea05a66"} Jul 28 16:20:08.779184 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:08.779155 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:20:08.779364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:08.779157 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:08.779364 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:08.779334 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:08.779364 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:08.779344 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:20:08.779513 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:08.779420 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:20:08.779513 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:08.779488 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:20:10.559898 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:10.559865 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:10.559950 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.560022 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.560065 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.560080 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs podName:6f8117b8-9615-4fbd-bd55-ced89f5b2127 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:42.560061704 +0000 UTC m=+66.222370938 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs") pod "network-metrics-daemon-h957s" (UID: "6f8117b8-9615-4fbd-bd55-ced89f5b2127") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:10.560105 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.560116 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret podName:af39ac3f-cffd-4cdf-8d42-5cecac6c8b62 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:42.560101549 +0000 UTC m=+66.222410784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret") pod "global-pull-secret-syncer-9rgxh" (UID: "af39ac3f-cffd-4cdf-8d42-5cecac6c8b62") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.560192 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.560208 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.560219 2549 projected.go:196] Error preparing data for projected volume kube-api-access-p7zht for pod openshift-network-diagnostics/network-check-target-xwcqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:20:10.560400 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.560259 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht podName:4d5726a9-e9bc-499a-8242-029988bfcf79 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:42.56024829 +0000 UTC m=+66.222557536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7zht" (UniqueName: "kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht") pod "network-check-target-xwcqh" (UID: "4d5726a9-e9bc-499a-8242-029988bfcf79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:20:10.779052 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:10.779017 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:20:10.779220 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:10.779025 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:10.779220 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.779134 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h957s" podUID="6f8117b8-9615-4fbd-bd55-ced89f5b2127" Jul 28 16:20:10.779220 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:10.779036 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:10.779220 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.779202 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwcqh" podUID="4d5726a9-e9bc-499a-8242-029988bfcf79" Jul 28 16:20:10.779404 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:10.779289 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rgxh" podUID="af39ac3f-cffd-4cdf-8d42-5cecac6c8b62" Jul 28 16:20:11.182977 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.182904 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-69.ec2.internal" event="NodeReady" Jul 28 16:20:11.183118 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.183019 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 16:20:11.220167 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.219990 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5477456fc5-dxthw"] Jul 28 16:20:11.222677 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.222655 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.225032 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.224918 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 16:20:11.225805 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.225761 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mm85l\"" Jul 28 16:20:11.225927 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.225813 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 16:20:11.228282 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.226879 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 16:20:11.233149 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.233112 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 16:20:11.233478 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.233458 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zhqrp"] Jul 28 16:20:11.235146 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.235128 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.237306 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.237289 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 16:20:11.237579 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.237549 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5477456fc5-dxthw"] Jul 28 16:20:11.237959 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.237942 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zjnr6\"" Jul 28 16:20:11.238038 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.237987 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 16:20:11.239214 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.239194 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zqpt7"] Jul 28 16:20:11.241998 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.241954 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zqpt7" Jul 28 16:20:11.243919 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.243895 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 16:20:11.244014 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.243945 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 16:20:11.244014 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.243895 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2z2b5\"" Jul 28 16:20:11.244226 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.244208 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 16:20:11.250604 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.250152 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zhqrp"] Jul 28 16:20:11.254922 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.254900 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zqpt7"] Jul 28 16:20:11.367524 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367488 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-image-registry-private-configuration\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.367524 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367527 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57ndt\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-kube-api-access-57ndt\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.367724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367569 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-trusted-ca\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.367724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367624 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-installation-pull-secrets\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.367724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367644 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6zzt\" (UniqueName: \"kubernetes.io/projected/d143b044-60a2-465f-84e7-9d57a496ca40-kube-api-access-d6zzt\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.367724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367666 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.367724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367690 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d143b044-60a2-465f-84e7-9d57a496ca40-tmp-dir\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.367942 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367796 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d143b044-60a2-465f-84e7-9d57a496ca40-config-volume\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.367942 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367850 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.367942 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367913 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40727c58-bc71-49a5-8e0e-ab71f1537b58-ca-trust-extracted\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.368055 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367954 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-certificates\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.368055 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367972 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75bvm\" (UniqueName: \"kubernetes.io/projected/ab309541-8f4a-4b53-8a21-b3ed782a8c3f-kube-api-access-75bvm\") pod \"ingress-canary-zqpt7\" (UID: \"ab309541-8f4a-4b53-8a21-b3ed782a8c3f\") " pod="openshift-ingress-canary/ingress-canary-zqpt7" Jul 28 16:20:11.368055 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.367998 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-bound-sa-token\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.368055 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.368022 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab309541-8f4a-4b53-8a21-b3ed782a8c3f-cert\") pod \"ingress-canary-zqpt7\" (UID: \"ab309541-8f4a-4b53-8a21-b3ed782a8c3f\") " pod="openshift-ingress-canary/ingress-canary-zqpt7" Jul 28 16:20:11.410973 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.410940 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:11.468989 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.468922 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-image-registry-private-configuration\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.468989 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.468960 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57ndt\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-kube-api-access-57ndt\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.469173 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.468994 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-trusted-ca\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.469173 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469019 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-installation-pull-secrets\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.469173 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469042 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6zzt\" (UniqueName: \"kubernetes.io/projected/d143b044-60a2-465f-84e7-9d57a496ca40-kube-api-access-d6zzt\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.469173 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469068 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.469173 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469093 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d143b044-60a2-465f-84e7-9d57a496ca40-tmp-dir\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.469173 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469117 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d143b044-60a2-465f-84e7-9d57a496ca40-config-volume\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.469173 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469138 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.469173 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469168 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40727c58-bc71-49a5-8e0e-ab71f1537b58-ca-trust-extracted\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.469574 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469197 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-certificates\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.469574 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469222 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75bvm\" (UniqueName: \"kubernetes.io/projected/ab309541-8f4a-4b53-8a21-b3ed782a8c3f-kube-api-access-75bvm\") pod \"ingress-canary-zqpt7\" (UID: \"ab309541-8f4a-4b53-8a21-b3ed782a8c3f\") " pod="openshift-ingress-canary/ingress-canary-zqpt7" Jul 28 16:20:11.469574 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469248 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-bound-sa-token\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.469574 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469271 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab309541-8f4a-4b53-8a21-b3ed782a8c3f-cert\") pod \"ingress-canary-zqpt7\" (UID: \"ab309541-8f4a-4b53-8a21-b3ed782a8c3f\") " pod="openshift-ingress-canary/ingress-canary-zqpt7" Jul 28 16:20:11.469794 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.469627 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:20:11.469794 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.469643 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5477456fc5-dxthw: secret "image-registry-tls" not found Jul 28 16:20:11.469794 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.469701 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls podName:40727c58-bc71-49a5-8e0e-ab71f1537b58 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:11.969682431 +0000 UTC m=+35.631991681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls") pod "image-registry-5477456fc5-dxthw" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58") : secret "image-registry-tls" not found Jul 28 16:20:11.469794 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.469739 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d143b044-60a2-465f-84e7-9d57a496ca40-config-volume\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.470484 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.470014 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d143b044-60a2-465f-84e7-9d57a496ca40-tmp-dir\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.470484 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.470144 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:20:11.470484 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.470196 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls podName:d143b044-60a2-465f-84e7-9d57a496ca40 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:11.9701828 +0000 UTC m=+35.632492038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls") pod "dns-default-zhqrp" (UID: "d143b044-60a2-465f-84e7-9d57a496ca40") : secret "dns-default-metrics-tls" not found Jul 28 16:20:11.470484 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.470277 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-trusted-ca\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.470484 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.470453 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-certificates\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.470484 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.470466 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40727c58-bc71-49a5-8e0e-ab71f1537b58-ca-trust-extracted\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.474001 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.473875 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-installation-pull-secrets\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.474109 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.473875 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-image-registry-private-configuration\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.474109 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.473885 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab309541-8f4a-4b53-8a21-b3ed782a8c3f-cert\") pod \"ingress-canary-zqpt7\" (UID: \"ab309541-8f4a-4b53-8a21-b3ed782a8c3f\") " pod="openshift-ingress-canary/ingress-canary-zqpt7" Jul 28 16:20:11.480126 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.480078 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6zzt\" (UniqueName: \"kubernetes.io/projected/d143b044-60a2-465f-84e7-9d57a496ca40-kube-api-access-d6zzt\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.481489 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.481467 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57ndt\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-kube-api-access-57ndt\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.481771 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.481747 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75bvm\" (UniqueName: \"kubernetes.io/projected/ab309541-8f4a-4b53-8a21-b3ed782a8c3f-kube-api-access-75bvm\") pod \"ingress-canary-zqpt7\" (UID: \"ab309541-8f4a-4b53-8a21-b3ed782a8c3f\") " pod="openshift-ingress-canary/ingress-canary-zqpt7" Jul 28 16:20:11.483230 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.483206 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-bound-sa-token\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.515020 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.514991 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:11.553084 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.553064 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zqpt7" Jul 28 16:20:11.951591 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.951566 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zqpt7"] Jul 28 16:20:11.956364 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:20:11.956338 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab309541_8f4a_4b53_8a21_b3ed782a8c3f.slice/crio-e4d81deb9b093c0bee8428cc02035b9019b1bf5b00450ef72d301a372469f3da WatchSource:0}: Error finding container e4d81deb9b093c0bee8428cc02035b9019b1bf5b00450ef72d301a372469f3da: Status 404 returned error can't find the container with id e4d81deb9b093c0bee8428cc02035b9019b1bf5b00450ef72d301a372469f3da Jul 28 16:20:11.973151 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.973129 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:11.973238 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:11.973214 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:11.973291 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.973274 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:20:11.973334 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.973297 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:20:11.973334 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.973306 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5477456fc5-dxthw: secret "image-registry-tls" not found Jul 28 16:20:11.973334 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.973332 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls podName:d143b044-60a2-465f-84e7-9d57a496ca40 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:12.973317683 +0000 UTC m=+36.635626917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls") pod "dns-default-zhqrp" (UID: "d143b044-60a2-465f-84e7-9d57a496ca40") : secret "dns-default-metrics-tls" not found Jul 28 16:20:11.973436 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:11.973348 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls podName:40727c58-bc71-49a5-8e0e-ab71f1537b58 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:12.973340052 +0000 UTC m=+36.635649286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls") pod "image-registry-5477456fc5-dxthw" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58") : secret "image-registry-tls" not found Jul 28 16:20:12.039049 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.039022 2549 generic.go:356] "Generic (PLEG): container finished" podID="40ddc838-b9e9-4da9-aab9-f897e6fd2d34" containerID="2c38e0fd1a5443e924e830bf89e57f73502566ec9ee7b56848e51655f9237a1e" exitCode=0 Jul 28 16:20:12.039157 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.039104 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" event={"ID":"40ddc838-b9e9-4da9-aab9-f897e6fd2d34","Type":"ContainerDied","Data":"2c38e0fd1a5443e924e830bf89e57f73502566ec9ee7b56848e51655f9237a1e"} Jul 28 16:20:12.043670 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.043640 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zqpt7" event={"ID":"ab309541-8f4a-4b53-8a21-b3ed782a8c3f","Type":"ContainerStarted","Data":"e4d81deb9b093c0bee8428cc02035b9019b1bf5b00450ef72d301a372469f3da"} Jul 28 16:20:12.779052 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.779020 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:12.779052 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.779045 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:20:12.779263 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.779025 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:12.781795 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.781760 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 16:20:12.781911 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.781819 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 16:20:12.781911 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.781839 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mdnvx\"" Jul 28 16:20:12.781911 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.781887 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 16:20:12.782078 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.781940 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 16:20:12.782078 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.781985 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5clrn\"" Jul 28 16:20:12.980842 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.980808 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:12.981178 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:12.980861 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:12.981178 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:12.980910 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:20:12.981178 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:12.980931 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5477456fc5-dxthw: secret "image-registry-tls" not found Jul 28 16:20:12.981178 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:12.980986 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls podName:40727c58-bc71-49a5-8e0e-ab71f1537b58 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:14.980966373 +0000 UTC m=+38.643275608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls") pod "image-registry-5477456fc5-dxthw" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58") : secret "image-registry-tls" not found Jul 28 16:20:12.981178 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:12.981047 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:20:12.981178 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:12.981099 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls podName:d143b044-60a2-465f-84e7-9d57a496ca40 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:14.981086891 +0000 UTC m=+38.643396138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls") pod "dns-default-zhqrp" (UID: "d143b044-60a2-465f-84e7-9d57a496ca40") : secret "dns-default-metrics-tls" not found Jul 28 16:20:13.049234 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:13.049169 2549 generic.go:356] "Generic (PLEG): container finished" podID="40ddc838-b9e9-4da9-aab9-f897e6fd2d34" containerID="2dfa822f5ccfa57010acdb7c926800929309322c6b5b09c82077deec277bac89" exitCode=0 Jul 28 16:20:13.049234 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:13.049210 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" event={"ID":"40ddc838-b9e9-4da9-aab9-f897e6fd2d34","Type":"ContainerDied","Data":"2dfa822f5ccfa57010acdb7c926800929309322c6b5b09c82077deec277bac89"} Jul 28 16:20:14.055890 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:14.055646 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" event={"ID":"40ddc838-b9e9-4da9-aab9-f897e6fd2d34","Type":"ContainerStarted","Data":"4eaf2a17d0d3c15fa024dad1c5f7356df6e20564a5b80fcbed0368ac961a6022"} Jul 28 16:20:14.078662 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:14.078605 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sfjfd" podStartSLOduration=8.601458106 podStartE2EDuration="37.078584854s" totalImagesPullingTime="28.477126748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:20:14.077532987 +0000 UTC m=+37.739842257" watchObservedRunningTime="2026-07-28 16:20:14.078584854 +0000 UTC m=+37.740894111" Jul 28 16:20:14.204555 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:14.204528 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:14.286215 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:14.286145 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:14.997075 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:14.997020 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:14.997075 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:14.997072 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:14.997253 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:14.997174 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:20:14.997253 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:14.997179 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:20:14.997253 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:14.997194 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5477456fc5-dxthw: secret "image-registry-tls" not found Jul 28 16:20:14.997253 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:14.997236 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls podName:40727c58-bc71-49a5-8e0e-ab71f1537b58 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:18.997220318 +0000 UTC m=+42.659529558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls") pod "image-registry-5477456fc5-dxthw" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58") : secret "image-registry-tls" not found Jul 28 16:20:14.997253 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:14.997251 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls podName:d143b044-60a2-465f-84e7-9d57a496ca40 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:18.997243593 +0000 UTC m=+42.659552827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls") pod "dns-default-zhqrp" (UID: "d143b044-60a2-465f-84e7-9d57a496ca40") : secret "dns-default-metrics-tls" not found Jul 28 16:20:15.059479 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:15.059450 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zqpt7" event={"ID":"ab309541-8f4a-4b53-8a21-b3ed782a8c3f","Type":"ContainerStarted","Data":"a0799839c472eb3620ff00c8092431d1a771d6a8afd5f190b5fe315798b37095"} Jul 28 16:20:15.074712 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:15.074637 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zqpt7" podStartSLOduration=1.6169494819999999 podStartE2EDuration="4.0746242s" totalImagesPullingTime="2.457674718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:20:15.074512765 +0000 UTC m=+38.736822021" watchObservedRunningTime="2026-07-28 16:20:15.0746242 +0000 UTC m=+38.736933447" Jul 28 16:20:15.473287 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:15.473258 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:15.573736 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:15.573710 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:19.019717 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:19.019685 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:19.020133 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:19.019721 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:19.020133 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:19.019850 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:20:19.020133 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:19.019854 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:20:19.020133 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:19.019869 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5477456fc5-dxthw: secret "image-registry-tls" not found Jul 28 16:20:19.020133 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:19.019911 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls podName:d143b044-60a2-465f-84e7-9d57a496ca40 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:27.01989477 +0000 UTC m=+50.682204006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls") pod "dns-default-zhqrp" (UID: "d143b044-60a2-465f-84e7-9d57a496ca40") : secret "dns-default-metrics-tls" not found Jul 28 16:20:19.020133 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:19.019923 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls podName:40727c58-bc71-49a5-8e0e-ab71f1537b58 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:27.01991742 +0000 UTC m=+50.682226654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls") pod "image-registry-5477456fc5-dxthw" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58") : secret "image-registry-tls" not found Jul 28 16:20:19.554708 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:19.554674 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:21.259731 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:21.259692 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:24.145868 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:24.145835 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:24.247054 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:24.247024 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:24.346132 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:24.346095 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:24.449788 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:24.449737 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:24.547875 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:24.547835 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:25.598994 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:25.598952 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:26.225324 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:26.225295 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:26.319105 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:26.319080 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:27.070571 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:27.070542 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:27.070571 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:27.070572 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:27.070978 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:27.070676 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:20:27.070978 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:27.070679 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:20:27.070978 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:27.070731 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5477456fc5-dxthw: secret "image-registry-tls" not found Jul 28 16:20:27.070978 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:27.070731 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls podName:d143b044-60a2-465f-84e7-9d57a496ca40 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:43.070715412 +0000 UTC m=+66.733024649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls") pod "dns-default-zhqrp" (UID: "d143b044-60a2-465f-84e7-9d57a496ca40") : secret "dns-default-metrics-tls" not found Jul 28 16:20:27.070978 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:27.070773 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls podName:40727c58-bc71-49a5-8e0e-ab71f1537b58 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:43.070762632 +0000 UTC m=+66.733071870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls") pod "image-registry-5477456fc5-dxthw" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58") : secret "image-registry-tls" not found Jul 28 16:20:31.674581 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:31.674480 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:33.087450 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:33.087404 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:33.186879 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:33.186844 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:34.646821 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:34.646765 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:34.747768 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:34.747736 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:36.031121 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:36.031089 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxdh4" Jul 28 16:20:36.187293 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:36.187258 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:36.262374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:36.262341 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:36.993649 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:36.993610 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:37.098929 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:37.098897 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:37.232686 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:37.232660 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:37.306791 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:37.306719 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:41.325700 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:41.325658 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:41.392252 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:41.392210 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:41.473107 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:41.473080 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:41.573199 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:41.573166 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:42.574896 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.574862 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:42.574896 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.574898 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:42.575291 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.574919 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:20:42.577207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.577187 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 16:20:42.577290 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.577272 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 16:20:42.577365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.577348 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 16:20:42.585916 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:42.585901 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 16:20:42.585971 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:42.585960 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs podName:6f8117b8-9615-4fbd-bd55-ced89f5b2127 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:46.585947143 +0000 UTC m=+130.248256379 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs") pod "network-metrics-daemon-h957s" (UID: "6f8117b8-9615-4fbd-bd55-ced89f5b2127") : secret "metrics-daemon-secret" not found Jul 28 16:20:42.587406 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.587394 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 16:20:42.589471 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.589450 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af39ac3f-cffd-4cdf-8d42-5cecac6c8b62-original-pull-secret\") pod \"global-pull-secret-syncer-9rgxh\" (UID: \"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62\") " pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:42.598524 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.598495 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7zht\" (UniqueName: \"kubernetes.io/projected/4d5726a9-e9bc-499a-8242-029988bfcf79-kube-api-access-p7zht\") pod \"network-check-target-xwcqh\" (UID: \"4d5726a9-e9bc-499a-8242-029988bfcf79\") " pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:42.792914 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.792896 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5clrn\"" Jul 28 16:20:42.798309 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.798294 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rgxh" Jul 28 16:20:42.801437 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.801422 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:42.965900 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.965871 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9rgxh"] Jul 28 16:20:42.971081 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:20:42.971046 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf39ac3f_cffd_4cdf_8d42_5cecac6c8b62.slice/crio-e44ddfc4805d535f1625448ec1b6db3c5edbbb8ac8f6973dc867da0d11430ace WatchSource:0}: Error finding container e44ddfc4805d535f1625448ec1b6db3c5edbbb8ac8f6973dc867da0d11430ace: Status 404 returned error can't find the container with id e44ddfc4805d535f1625448ec1b6db3c5edbbb8ac8f6973dc867da0d11430ace Jul 28 16:20:42.977222 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:42.977202 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xwcqh"] Jul 28 16:20:42.979820 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:20:42.979799 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5726a9_e9bc_499a_8242_029988bfcf79.slice/crio-526a597414c5d6475e11201fdddfa86ae4be5acadc078323a084d6df9832f788 WatchSource:0}: Error finding container 526a597414c5d6475e11201fdddfa86ae4be5acadc078323a084d6df9832f788: Status 404 returned error can't find the container with id 526a597414c5d6475e11201fdddfa86ae4be5acadc078323a084d6df9832f788 Jul 28 16:20:43.078517 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:43.078490 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:20:43.078612 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:43.078530 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:20:43.078671 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:43.078630 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:20:43.078671 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:43.078645 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5477456fc5-dxthw: secret "image-registry-tls" not found Jul 28 16:20:43.078671 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:43.078648 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:20:43.078796 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:43.078690 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls podName:40727c58-bc71-49a5-8e0e-ab71f1537b58 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:15.078676068 +0000 UTC m=+98.740985302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls") pod "image-registry-5477456fc5-dxthw" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58") : secret "image-registry-tls" not found Jul 28 16:20:43.078796 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:43.078703 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls podName:d143b044-60a2-465f-84e7-9d57a496ca40 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:15.078697297 +0000 UTC m=+98.741006531 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls") pod "dns-default-zhqrp" (UID: "d143b044-60a2-465f-84e7-9d57a496ca40") : secret "dns-default-metrics-tls" not found Jul 28 16:20:43.126523 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:43.126472 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xwcqh" event={"ID":"4d5726a9-e9bc-499a-8242-029988bfcf79","Type":"ContainerStarted","Data":"526a597414c5d6475e11201fdddfa86ae4be5acadc078323a084d6df9832f788"} Jul 28 16:20:43.127493 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:43.127475 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9rgxh" event={"ID":"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62","Type":"ContainerStarted","Data":"e44ddfc4805d535f1625448ec1b6db3c5edbbb8ac8f6973dc867da0d11430ace"} Jul 28 16:20:48.142929 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:48.142887 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xwcqh" event={"ID":"4d5726a9-e9bc-499a-8242-029988bfcf79","Type":"ContainerStarted","Data":"81b334160ddb22b039194f4f3a0060dfd6962b3ab9d35379ae5ca375b63716c7"} Jul 28 16:20:48.143446 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:48.142976 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:20:48.144415 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:48.144391 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9rgxh" event={"ID":"af39ac3f-cffd-4cdf-8d42-5cecac6c8b62","Type":"ContainerStarted","Data":"864b1cb6502d10d22e98bb4d7c38ac71d15639a5d6437fdcb200506960a510bb"} Jul 28 16:20:48.159540 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:48.159500 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xwcqh" podStartSLOduration=66.707436043 podStartE2EDuration="1m11.159484s" totalImagesPullingTime="4.452047957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:20:48.158503307 +0000 UTC m=+71.820812566" watchObservedRunningTime="2026-07-28 16:20:48.159484 +0000 UTC m=+71.821793259" Jul 28 16:20:48.173774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:48.173732 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9rgxh" podStartSLOduration=66.710639052 podStartE2EDuration="1m11.173721409s" totalImagesPullingTime="4.463082357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:20:48.173389876 +0000 UTC m=+71.835699129" watchObservedRunningTime="2026-07-28 16:20:48.173721409 +0000 UTC m=+71.836030665" Jul 28 16:20:56.225757 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.225722 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck"] Jul 28 16:20:56.227823 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.227798 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:20:56.229746 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.229704 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 16:20:56.229897 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.229837 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 16:20:56.230315 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.230298 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:20:56.230390 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.230350 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jf8m5\"" Jul 28 16:20:56.247302 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.247279 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck"] Jul 28 16:20:56.263265 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.263236 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49swq\" (UniqueName: \"kubernetes.io/projected/b71d8700-7d8f-424c-8740-381b675c3732-kube-api-access-49swq\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:20:56.263347 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.263285 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:20:56.323747 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.323728 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-npccl"] Jul 28 16:20:56.325450 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.325436 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.327325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.327307 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:20:56.327438 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.327337 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 16:20:56.327438 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.327383 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 16:20:56.327438 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.327389 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5cdwj\"" Jul 28 16:20:56.327554 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.327540 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 16:20:56.332704 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.332687 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 16:20:56.337195 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.337176 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-npccl"] Jul 28 16:20:56.364019 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.363998 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e8b4d7a-6c66-449e-86a7-b9579a311364-config\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.364094 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.364034 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e8b4d7a-6c66-449e-86a7-b9579a311364-serving-cert\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.364094 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.364060 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:20:56.364165 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.364144 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jckzc\" (UniqueName: \"kubernetes.io/projected/5e8b4d7a-6c66-449e-86a7-b9579a311364-kube-api-access-jckzc\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.364197 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.364174 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e8b4d7a-6c66-449e-86a7-b9579a311364-trusted-ca\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.364231 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:56.364153 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 16:20:56.364231 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.364204 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49swq\" (UniqueName: \"kubernetes.io/projected/b71d8700-7d8f-424c-8740-381b675c3732-kube-api-access-49swq\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:20:56.364288 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:56.364253 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls podName:b71d8700-7d8f-424c-8740-381b675c3732 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:56.864240343 +0000 UTC m=+80.526549578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls") pod "cluster-samples-operator-6748489656-bv2ck" (UID: "b71d8700-7d8f-424c-8740-381b675c3732") : secret "samples-operator-tls" not found Jul 28 16:20:56.374515 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.374492 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49swq\" (UniqueName: \"kubernetes.io/projected/b71d8700-7d8f-424c-8740-381b675c3732-kube-api-access-49swq\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:20:56.405376 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.405349 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:56.464452 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.464431 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e8b4d7a-6c66-449e-86a7-b9579a311364-config\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.464534 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.464468 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e8b4d7a-6c66-449e-86a7-b9579a311364-serving-cert\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.464534 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.464521 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jckzc\" (UniqueName: \"kubernetes.io/projected/5e8b4d7a-6c66-449e-86a7-b9579a311364-kube-api-access-jckzc\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.464608 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.464539 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e8b4d7a-6c66-449e-86a7-b9579a311364-trusted-ca\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.465180 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.465153 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e8b4d7a-6c66-449e-86a7-b9579a311364-config\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.465343 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.465327 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e8b4d7a-6c66-449e-86a7-b9579a311364-trusted-ca\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.466558 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.466537 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e8b4d7a-6c66-449e-86a7-b9579a311364-serving-cert\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.473430 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.473407 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jckzc\" (UniqueName: \"kubernetes.io/projected/5e8b4d7a-6c66-449e-86a7-b9579a311364-kube-api-access-jckzc\") pod \"console-operator-584dcb6b54-npccl\" (UID: \"5e8b4d7a-6c66-449e-86a7-b9579a311364\") " pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.505123 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.505069 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:56.633935 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.633912 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:20:56.745836 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.745395 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-npccl"] Jul 28 16:20:56.750038 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:20:56.750013 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8b4d7a_6c66_449e_86a7_b9579a311364.slice/crio-2430590d9d40a7a84f10e0290fcc87d08cbcccf3ef871b0e8428ef52386e7c65 WatchSource:0}: Error finding container 2430590d9d40a7a84f10e0290fcc87d08cbcccf3ef871b0e8428ef52386e7c65: Status 404 returned error can't find the container with id 2430590d9d40a7a84f10e0290fcc87d08cbcccf3ef871b0e8428ef52386e7c65 Jul 28 16:20:56.866729 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:56.866704 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:20:56.866892 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:56.866873 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 16:20:56.866967 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:56.866956 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls podName:b71d8700-7d8f-424c-8740-381b675c3732 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:57.866936447 +0000 UTC m=+81.529245699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls") pod "cluster-samples-operator-6748489656-bv2ck" (UID: "b71d8700-7d8f-424c-8740-381b675c3732") : secret "samples-operator-tls" not found Jul 28 16:20:57.167528 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:57.167460 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" event={"ID":"5e8b4d7a-6c66-449e-86a7-b9579a311364","Type":"ContainerStarted","Data":"2430590d9d40a7a84f10e0290fcc87d08cbcccf3ef871b0e8428ef52386e7c65"} Jul 28 16:20:57.873923 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:57.873885 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:20:57.874377 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:57.874069 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 16:20:57.874377 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:57.874134 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls podName:b71d8700-7d8f-424c-8740-381b675c3732 nodeName:}" failed. No retries permitted until 2026-07-28 16:20:59.874120297 +0000 UTC m=+83.536429556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls") pod "cluster-samples-operator-6748489656-bv2ck" (UID: "b71d8700-7d8f-424c-8740-381b675c3732") : secret "samples-operator-tls" not found Jul 28 16:20:58.654287 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:58.654254 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:58.747478 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:58.747438 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:59.174946 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.174921 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/0.log" Jul 28 16:20:59.175275 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.174958 2549 generic.go:356] "Generic (PLEG): container finished" podID="5e8b4d7a-6c66-449e-86a7-b9579a311364" containerID="57d9c9ab18a725619d5d597ea1c029ec3d9995c804acca99467dd9e664c52c5a" exitCode=255 Jul 28 16:20:59.175275 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.175004 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" event={"ID":"5e8b4d7a-6c66-449e-86a7-b9579a311364","Type":"ContainerDied","Data":"57d9c9ab18a725619d5d597ea1c029ec3d9995c804acca99467dd9e664c52c5a"} Jul 28 16:20:59.175275 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.175201 2549 scope.go:117] "RemoveContainer" containerID="57d9c9ab18a725619d5d597ea1c029ec3d9995c804acca99467dd9e664c52c5a" Jul 28 16:20:59.236328 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.236302 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd"] Jul 28 16:20:59.238147 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.238130 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.240134 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.240104 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 16:20:59.240134 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.240121 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:20:59.240299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.240196 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 16:20:59.240299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.240224 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 16:20:59.240525 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.240505 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vm5zt\"" Jul 28 16:20:59.247570 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.247547 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd"] Jul 28 16:20:59.284749 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.284726 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/664cd821-5b25-4de0-be52-c62643b02f1a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd\" (UID: \"664cd821-5b25-4de0-be52-c62643b02f1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.284863 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.284759 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/664cd821-5b25-4de0-be52-c62643b02f1a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd\" (UID: \"664cd821-5b25-4de0-be52-c62643b02f1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.284863 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.284829 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4cn6\" (UniqueName: \"kubernetes.io/projected/664cd821-5b25-4de0-be52-c62643b02f1a-kube-api-access-g4cn6\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd\" (UID: \"664cd821-5b25-4de0-be52-c62643b02f1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.385707 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.385618 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/664cd821-5b25-4de0-be52-c62643b02f1a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd\" (UID: \"664cd821-5b25-4de0-be52-c62643b02f1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.385707 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.385646 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/664cd821-5b25-4de0-be52-c62643b02f1a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd\" (UID: \"664cd821-5b25-4de0-be52-c62643b02f1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.385707 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.385667 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4cn6\" (UniqueName: \"kubernetes.io/projected/664cd821-5b25-4de0-be52-c62643b02f1a-kube-api-access-g4cn6\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd\" (UID: \"664cd821-5b25-4de0-be52-c62643b02f1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.386243 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.386224 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/664cd821-5b25-4de0-be52-c62643b02f1a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd\" (UID: \"664cd821-5b25-4de0-be52-c62643b02f1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.387660 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.387639 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/664cd821-5b25-4de0-be52-c62643b02f1a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd\" (UID: \"664cd821-5b25-4de0-be52-c62643b02f1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.394389 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.394372 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4cn6\" (UniqueName: \"kubernetes.io/projected/664cd821-5b25-4de0-be52-c62643b02f1a-kube-api-access-g4cn6\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd\" (UID: \"664cd821-5b25-4de0-be52-c62643b02f1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.546873 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.546844 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" Jul 28 16:20:59.661494 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.661468 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd"] Jul 28 16:20:59.664485 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:20:59.664461 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664cd821_5b25_4de0_be52_c62643b02f1a.slice/crio-51bdfb5dacc8093e02456de0b45c84418c71b914cdb79dd9b4da751b2274ec16 WatchSource:0}: Error finding container 51bdfb5dacc8093e02456de0b45c84418c71b914cdb79dd9b4da751b2274ec16: Status 404 returned error can't find the container with id 51bdfb5dacc8093e02456de0b45c84418c71b914cdb79dd9b4da751b2274ec16 Jul 28 16:20:59.877582 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.877523 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6mlmm"] Jul 28 16:20:59.880256 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.880241 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:20:59.884915 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.884895 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 16:20:59.885023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.884917 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 16:20:59.885023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.884934 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5rwtc\"" Jul 28 16:20:59.885023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.884958 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 16:20:59.885023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.884975 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 16:20:59.888411 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.888392 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:20:59.888543 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:59.888526 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 16:20:59.888615 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:20:59.888578 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls podName:b71d8700-7d8f-424c-8740-381b675c3732 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:03.888564794 +0000 UTC m=+87.550874032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls") pod "cluster-samples-operator-6748489656-bv2ck" (UID: "b71d8700-7d8f-424c-8740-381b675c3732") : secret "samples-operator-tls" not found Jul 28 16:20:59.902751 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.902733 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mlmm"] Jul 28 16:20:59.947857 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.947829 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:20:59.989409 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.989387 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8shsq\" (UniqueName: \"kubernetes.io/projected/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-api-access-8shsq\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:20:59.989510 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.989421 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e78c507b-e4dd-492a-abfc-bbc2c9148d81-crio-socket\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:20:59.989510 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.989469 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:20:59.989628 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.989548 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78c507b-e4dd-492a-abfc-bbc2c9148d81-data-volume\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:20:59.989667 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:20:59.989642 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.020584 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.020563 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:00.090913 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.090891 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.091000 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.090925 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8shsq\" (UniqueName: \"kubernetes.io/projected/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-api-access-8shsq\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.091000 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.090945 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e78c507b-e4dd-492a-abfc-bbc2c9148d81-crio-socket\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.091000 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.090987 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.091131 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.091034 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78c507b-e4dd-492a-abfc-bbc2c9148d81-data-volume\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.091131 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:00.091038 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:21:00.091131 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:00.091089 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:00.591073509 +0000 UTC m=+84.253382764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : secret "insights-runtime-extractor-tls" not found Jul 28 16:21:00.091131 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.091100 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e78c507b-e4dd-492a-abfc-bbc2c9148d81-crio-socket\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.091131 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:00.091127 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:21:00.091321 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:00.091192 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:00.591176396 +0000 UTC m=+84.253485646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : configmap "kube-rbac-proxy" not found Jul 28 16:21:00.091321 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.091313 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78c507b-e4dd-492a-abfc-bbc2c9148d81-data-volume\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.103120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.103100 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8shsq\" (UniqueName: \"kubernetes.io/projected/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-api-access-8shsq\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.178040 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.177976 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" event={"ID":"664cd821-5b25-4de0-be52-c62643b02f1a","Type":"ContainerStarted","Data":"51bdfb5dacc8093e02456de0b45c84418c71b914cdb79dd9b4da751b2274ec16"} Jul 28 16:21:00.179361 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.179346 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/1.log" Jul 28 16:21:00.179704 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.179691 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/0.log" Jul 28 16:21:00.179758 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.179721 2549 generic.go:356] "Generic (PLEG): container finished" podID="5e8b4d7a-6c66-449e-86a7-b9579a311364" containerID="7c0a04ec94e873fd9136f65e9f4e494f9d73eb933a19ed9c1c03aae8a01ac132" exitCode=255 Jul 28 16:21:00.179824 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.179748 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" event={"ID":"5e8b4d7a-6c66-449e-86a7-b9579a311364","Type":"ContainerDied","Data":"7c0a04ec94e873fd9136f65e9f4e494f9d73eb933a19ed9c1c03aae8a01ac132"} Jul 28 16:21:00.179824 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.179819 2549 scope.go:117] "RemoveContainer" containerID="57d9c9ab18a725619d5d597ea1c029ec3d9995c804acca99467dd9e664c52c5a" Jul 28 16:21:00.179996 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.179975 2549 scope.go:117] "RemoveContainer" containerID="7c0a04ec94e873fd9136f65e9f4e494f9d73eb933a19ed9c1c03aae8a01ac132" Jul 28 16:21:00.180156 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:00.180135 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-npccl_openshift-console-operator(5e8b4d7a-6c66-449e-86a7-b9579a311364)\"" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" podUID="5e8b4d7a-6c66-449e-86a7-b9579a311364" Jul 28 16:21:00.594987 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.594952 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.595179 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:00.595054 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:00.595179 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:00.595080 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:21:00.595179 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:00.595160 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:01.595141011 +0000 UTC m=+85.257450249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : configmap "kube-rbac-proxy" not found Jul 28 16:21:00.595179 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:00.595162 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:21:00.595402 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:00.595210 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:01.595193226 +0000 UTC m=+85.257502461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : secret "insights-runtime-extractor-tls" not found Jul 28 16:21:01.184709 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:01.184679 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/1.log" Jul 28 16:21:01.185146 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:01.185122 2549 scope.go:117] "RemoveContainer" containerID="7c0a04ec94e873fd9136f65e9f4e494f9d73eb933a19ed9c1c03aae8a01ac132" Jul 28 16:21:01.185336 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:01.185302 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-npccl_openshift-console-operator(5e8b4d7a-6c66-449e-86a7-b9579a311364)\"" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" podUID="5e8b4d7a-6c66-449e-86a7-b9579a311364" Jul 28 16:21:01.604207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:01.604167 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:01.604423 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:01.604267 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:01.604423 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:01.604289 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:21:01.604423 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:01.604353 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:03.604337567 +0000 UTC m=+87.266646802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : configmap "kube-rbac-proxy" not found Jul 28 16:21:01.604423 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:01.604370 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:21:01.604423 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:01.604414 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:03.604401634 +0000 UTC m=+87.266710874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : secret "insights-runtime-extractor-tls" not found Jul 28 16:21:02.079027 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:02.079003 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nlrwd_9f8166bc-ce1e-4979-b234-66c97b474e89/dns-node-resolver/0.log" Jul 28 16:21:02.188831 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:02.188798 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" event={"ID":"664cd821-5b25-4de0-be52-c62643b02f1a","Type":"ContainerStarted","Data":"7b8df4a866b4e32fd3892a26c8c45bf2bb6bbfb3c20ed97f865ff65153aebb6d"} Jul 28 16:21:02.209528 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:02.209479 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" podStartSLOduration=1.257582248 podStartE2EDuration="3.209461866s" totalImagesPullingTime="1.951879618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:02.208811009 +0000 UTC m=+85.871120263" watchObservedRunningTime="2026-07-28 16:21:02.209461866 +0000 UTC m=+85.871771126" Jul 28 16:21:02.478908 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:02.478882 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6b6zr_b754674c-43ab-4e8d-a7dd-08330fa21b80/node-ca/0.log" Jul 28 16:21:03.121967 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:03.121926 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:03.208022 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:03.207981 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:03.277521 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:03.277487 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:03.377614 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:03.377539 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:03.445794 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:03.445755 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:03.618660 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:03.618624 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:03.618865 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:03.618696 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:03.618865 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:03.618775 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:21:03.618865 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:03.618847 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:21:03.618990 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:03.618858 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:07.618844058 +0000 UTC m=+91.281153297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : secret "insights-runtime-extractor-tls" not found Jul 28 16:21:03.618990 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:03.618929 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:07.618909109 +0000 UTC m=+91.281218357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : configmap "kube-rbac-proxy" not found Jul 28 16:21:03.680893 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:03.680806 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zqpt7_ab309541-8f4a-4b53-8a21-b3ed782a8c3f/serve-healthcheck-canary/0.log" Jul 28 16:21:03.921917 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:03.921886 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:21:03.922071 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:03.922035 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 16:21:03.922109 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:03.922099 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls podName:b71d8700-7d8f-424c-8740-381b675c3732 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:11.922084023 +0000 UTC m=+95.584393262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls") pod "cluster-samples-operator-6748489656-bv2ck" (UID: "b71d8700-7d8f-424c-8740-381b675c3732") : secret "samples-operator-tls" not found Jul 28 16:21:06.315321 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:06.315288 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:06.416908 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:06.416870 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:06.634665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:06.634581 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:21:06.634665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:06.634626 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:21:06.634956 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:06.634944 2549 scope.go:117] "RemoveContainer" containerID="7c0a04ec94e873fd9136f65e9f4e494f9d73eb933a19ed9c1c03aae8a01ac132" Jul 28 16:21:06.635103 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:06.635085 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-npccl_openshift-console-operator(5e8b4d7a-6c66-449e-86a7-b9579a311364)\"" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" podUID="5e8b4d7a-6c66-449e-86a7-b9579a311364" Jul 28 16:21:07.648669 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:07.648638 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:07.649057 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:07.648689 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:07.649057 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:07.648760 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:21:07.649057 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:07.648823 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:15.648809715 +0000 UTC m=+99.311118950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : configmap "kube-rbac-proxy" not found Jul 28 16:21:07.649057 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:07.648820 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:21:07.649057 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:07.648847 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:15.648841414 +0000 UTC m=+99.311150648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : secret "insights-runtime-extractor-tls" not found Jul 28 16:21:09.548485 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:09.548451 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:09.648143 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:09.648108 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:10.266027 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:10.265997 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:10.366196 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:10.366151 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:11.919539 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:11.919497 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:11.984012 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:11.983983 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:21:11.984118 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:11.984088 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 16:21:11.984169 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:11.984145 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls podName:b71d8700-7d8f-424c-8740-381b675c3732 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:27.984127463 +0000 UTC m=+111.646436697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls") pod "cluster-samples-operator-6748489656-bv2ck" (UID: "b71d8700-7d8f-424c-8740-381b675c3732") : secret "samples-operator-tls" not found Jul 28 16:21:12.023254 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:12.023225 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:13.142457 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:13.142426 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:13.379574 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:13.379537 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:13.775793 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:13.775742 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:14.054120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:14.054017 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:14.156718 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:14.156675 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:14.268488 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:14.268450 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:14.409218 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:14.409136 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:14.513521 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:14.513491 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:15.108647 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:15.108552 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") pod \"image-registry-5477456fc5-dxthw\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:21:15.108850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:15.108726 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:21:15.108850 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:15.108732 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:21:15.108850 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:15.108800 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5477456fc5-dxthw: secret "image-registry-tls" not found Jul 28 16:21:15.108850 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:15.108805 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:21:15.109015 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:15.108857 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls podName:40727c58-bc71-49a5-8e0e-ab71f1537b58 nodeName:}" failed. No retries permitted until 2026-07-28 16:22:19.108843955 +0000 UTC m=+162.771153189 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls") pod "image-registry-5477456fc5-dxthw" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58") : secret "image-registry-tls" not found Jul 28 16:21:15.109015 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:15.108868 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls podName:d143b044-60a2-465f-84e7-9d57a496ca40 nodeName:}" failed. No retries permitted until 2026-07-28 16:22:19.108863067 +0000 UTC m=+162.771172302 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls") pod "dns-default-zhqrp" (UID: "d143b044-60a2-465f-84e7-9d57a496ca40") : secret "dns-default-metrics-tls" not found Jul 28 16:21:15.679210 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:15.679174 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:15.714709 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:15.714679 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:15.714842 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:15.714736 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:15.714897 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:15.714857 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:21:15.714930 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:15.714908 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls podName:e78c507b-e4dd-492a-abfc-bbc2c9148d81 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:31.7148944 +0000 UTC m=+115.377203636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mlmm" (UID: "e78c507b-e4dd-492a-abfc-bbc2c9148d81") : secret "insights-runtime-extractor-tls" not found Jul 28 16:21:15.715247 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:15.715229 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c507b-e4dd-492a-abfc-bbc2c9148d81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:16.411425 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:16.411392 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:16.511198 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:16.511164 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:17.480375 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:17.480344 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:17.580791 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:17.580741 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:17.681219 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:17.681191 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:17.888578 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:17.888495 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:18.072623 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:18.072589 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:18.270538 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:18.270497 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:18.374406 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:18.374375 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:18.498687 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:18.498650 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:18.783282 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:18.783258 2549 scope.go:117] "RemoveContainer" containerID="7c0a04ec94e873fd9136f65e9f4e494f9d73eb933a19ed9c1c03aae8a01ac132" Jul 28 16:21:19.149850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.149764 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xwcqh" Jul 28 16:21:19.156493 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.156447 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:19.231274 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.231248 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:21:19.231640 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.231624 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/1.log" Jul 28 16:21:19.231693 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.231657 2549 generic.go:356] "Generic (PLEG): container finished" podID="5e8b4d7a-6c66-449e-86a7-b9579a311364" containerID="1668c5cb2680c49cb99ec5df30ee7f3e3eda0aa352cb8f0a8b8cc11a3a5e5efd" exitCode=255 Jul 28 16:21:19.231741 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.231694 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" event={"ID":"5e8b4d7a-6c66-449e-86a7-b9579a311364","Type":"ContainerDied","Data":"1668c5cb2680c49cb99ec5df30ee7f3e3eda0aa352cb8f0a8b8cc11a3a5e5efd"} Jul 28 16:21:19.231741 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.231739 2549 scope.go:117] "RemoveContainer" containerID="7c0a04ec94e873fd9136f65e9f4e494f9d73eb933a19ed9c1c03aae8a01ac132" Jul 28 16:21:19.232129 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.232104 2549 scope.go:117] "RemoveContainer" containerID="1668c5cb2680c49cb99ec5df30ee7f3e3eda0aa352cb8f0a8b8cc11a3a5e5efd" Jul 28 16:21:19.232282 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:19.232263 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-npccl_openshift-console-operator(5e8b4d7a-6c66-449e-86a7-b9579a311364)\"" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" podUID="5e8b4d7a-6c66-449e-86a7-b9579a311364" Jul 28 16:21:19.486202 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.486168 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:19.899732 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:19.899649 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:20.127214 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:20.127170 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:20.235161 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:20.235135 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:21:20.289097 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:20.289065 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:20.388940 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:20.388898 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:20.670800 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:20.670698 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:20.932912 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:20.932833 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:21.019037 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:21.019004 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:21.589112 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:21.589075 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:21.871123 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:21.871046 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:22.070292 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:22.070254 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:22.471464 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:22.471425 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:22.666444 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:22.666406 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:22.888456 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:22.888358 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:23.874961 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:23.874926 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:24.070873 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:24.070837 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:24.275089 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:24.275050 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:24.468547 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:24.468506 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:26.634766 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:26.634730 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:21:26.635232 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:26.634827 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:21:26.635232 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:26.635133 2549 scope.go:117] "RemoveContainer" containerID="1668c5cb2680c49cb99ec5df30ee7f3e3eda0aa352cb8f0a8b8cc11a3a5e5efd" Jul 28 16:21:26.635353 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:26.635281 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-npccl_openshift-console-operator(5e8b4d7a-6c66-449e-86a7-b9579a311364)\"" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" podUID="5e8b4d7a-6c66-449e-86a7-b9579a311364" Jul 28 16:21:28.016693 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:28.016642 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:21:28.018946 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:28.018926 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b71d8700-7d8f-424c-8740-381b675c3732-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bv2ck\" (UID: \"b71d8700-7d8f-424c-8740-381b675c3732\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:21:28.036021 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:28.035999 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" Jul 28 16:21:28.155076 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:28.155047 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck"] Jul 28 16:21:28.253613 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:28.253588 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" event={"ID":"b71d8700-7d8f-424c-8740-381b675c3732","Type":"ContainerStarted","Data":"1c86903d81ace34a47a2f7e8cce55e665f442bd3ceee2fa4d8738476ff0c2056"} Jul 28 16:21:30.261561 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:30.261522 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" event={"ID":"b71d8700-7d8f-424c-8740-381b675c3732","Type":"ContainerStarted","Data":"3f5bf0cc6f9c2fcd10b79429e2e9b5f8926aaff8510eb71ccdbff65a62e2f6a9"} Jul 28 16:21:30.261966 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:30.261602 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" event={"ID":"b71d8700-7d8f-424c-8740-381b675c3732","Type":"ContainerStarted","Data":"e313e428472af6f2db7a7069fbb75700aaf6e54cc0e41fd697eec373a2c6c2d7"} Jul 28 16:21:30.278759 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:30.278715 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bv2ck" podStartSLOduration=32.778275503 podStartE2EDuration="34.278701053s" totalImagesPullingTime="1.50042555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:30.277990504 +0000 UTC m=+113.940299762" watchObservedRunningTime="2026-07-28 16:21:30.278701053 +0000 UTC m=+113.941010309" Jul 28 16:21:30.879863 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:30.879801 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:30.979757 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:30.979727 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:31.080763 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:31.080730 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:31.745023 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:31.744985 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:31.747358 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:31.747332 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c507b-e4dd-492a-abfc-bbc2c9148d81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mlmm\" (UID: \"e78c507b-e4dd-492a-abfc-bbc2c9148d81\") " pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:31.777016 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:31.776988 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:31.989294 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:31.989265 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mlmm" Jul 28 16:21:32.092438 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.092408 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt"] Jul 28 16:21:32.094858 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.094841 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" Jul 28 16:21:32.097895 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.097844 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 16:21:32.097895 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.097876 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 16:21:32.098071 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.097897 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 28 16:21:32.098071 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.097879 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 16:21:32.098071 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.097844 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-frbdp\"" Jul 28 16:21:32.107183 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.107161 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt"] Jul 28 16:21:32.134024 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.134000 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mlmm"] Jul 28 16:21:32.134874 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:32.134850 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78c507b_e4dd_492a_abfc_bbc2c9148d81.slice/crio-566d0188afd173fb642253a141bb8777072fd69da6245c0cca18c574fa37c727 WatchSource:0}: Error finding container 566d0188afd173fb642253a141bb8777072fd69da6245c0cca18c574fa37c727: Status 404 returned error can't find the container with id 566d0188afd173fb642253a141bb8777072fd69da6245c0cca18c574fa37c727 Jul 28 16:21:32.189472 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.189448 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l"] Jul 28 16:21:32.191627 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.191609 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" Jul 28 16:21:32.196013 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.195997 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hcl7r\"" Jul 28 16:21:32.196246 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.196233 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 16:21:32.209428 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.209408 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l"] Jul 28 16:21:32.250704 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.250635 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sglvv\" (UniqueName: \"kubernetes.io/projected/9bfe47cf-ef70-4778-a1b8-1f2847c2cc09-kube-api-access-sglvv\") pod \"managed-serviceaccount-addon-agent-6c988945d4-pzzvt\" (UID: \"9bfe47cf-ef70-4778-a1b8-1f2847c2cc09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" Jul 28 16:21:32.250704 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.250701 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9bfe47cf-ef70-4778-a1b8-1f2847c2cc09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c988945d4-pzzvt\" (UID: \"9bfe47cf-ef70-4778-a1b8-1f2847c2cc09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" Jul 28 16:21:32.253522 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.253498 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:32.267469 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.267442 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mlmm" event={"ID":"e78c507b-e4dd-492a-abfc-bbc2c9148d81","Type":"ContainerStarted","Data":"566d0188afd173fb642253a141bb8777072fd69da6245c0cca18c574fa37c727"} Jul 28 16:21:32.351861 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.351827 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bb4b9915-7f46-44ae-b771-410002dcd01c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-r978l\" (UID: \"bb4b9915-7f46-44ae-b771-410002dcd01c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" Jul 28 16:21:32.351986 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.351869 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9bfe47cf-ef70-4778-a1b8-1f2847c2cc09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c988945d4-pzzvt\" (UID: \"9bfe47cf-ef70-4778-a1b8-1f2847c2cc09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" Jul 28 16:21:32.351986 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.351946 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sglvv\" (UniqueName: \"kubernetes.io/projected/9bfe47cf-ef70-4778-a1b8-1f2847c2cc09-kube-api-access-sglvv\") pod \"managed-serviceaccount-addon-agent-6c988945d4-pzzvt\" (UID: \"9bfe47cf-ef70-4778-a1b8-1f2847c2cc09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" Jul 28 16:21:32.354362 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.354340 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9bfe47cf-ef70-4778-a1b8-1f2847c2cc09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c988945d4-pzzvt\" (UID: \"9bfe47cf-ef70-4778-a1b8-1f2847c2cc09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" Jul 28 16:21:32.355585 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.355538 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:32.361452 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.361433 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sglvv\" (UniqueName: \"kubernetes.io/projected/9bfe47cf-ef70-4778-a1b8-1f2847c2cc09-kube-api-access-sglvv\") pod \"managed-serviceaccount-addon-agent-6c988945d4-pzzvt\" (UID: \"9bfe47cf-ef70-4778-a1b8-1f2847c2cc09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" Jul 28 16:21:32.421918 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.421891 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" Jul 28 16:21:32.452904 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.452761 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bb4b9915-7f46-44ae-b771-410002dcd01c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-r978l\" (UID: \"bb4b9915-7f46-44ae-b771-410002dcd01c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" Jul 28 16:21:32.455231 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.455207 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bb4b9915-7f46-44ae-b771-410002dcd01c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-r978l\" (UID: \"bb4b9915-7f46-44ae-b771-410002dcd01c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" Jul 28 16:21:32.500046 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.500018 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" Jul 28 16:21:32.551410 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.551348 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt"] Jul 28 16:21:32.555768 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:32.555735 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bfe47cf_ef70_4778_a1b8_1f2847c2cc09.slice/crio-73304b85c7e45c588b61bf92690a5f2ced7d9f38d65a741985f289f2c91ebbab WatchSource:0}: Error finding container 73304b85c7e45c588b61bf92690a5f2ced7d9f38d65a741985f289f2c91ebbab: Status 404 returned error can't find the container with id 73304b85c7e45c588b61bf92690a5f2ced7d9f38d65a741985f289f2c91ebbab Jul 28 16:21:32.658351 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:32.657160 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l"] Jul 28 16:21:32.662171 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:32.662140 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4b9915_7f46_44ae_b771_410002dcd01c.slice/crio-a4da8d0fc0530a2d5c56c95b8fa30c16b382dc505a545530ba84125b9c2078a4 WatchSource:0}: Error finding container a4da8d0fc0530a2d5c56c95b8fa30c16b382dc505a545530ba84125b9c2078a4: Status 404 returned error can't find the container with id a4da8d0fc0530a2d5c56c95b8fa30c16b382dc505a545530ba84125b9c2078a4 Jul 28 16:21:33.277698 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:33.277656 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" event={"ID":"bb4b9915-7f46-44ae-b771-410002dcd01c","Type":"ContainerStarted","Data":"a4da8d0fc0530a2d5c56c95b8fa30c16b382dc505a545530ba84125b9c2078a4"} Jul 28 16:21:33.279091 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:33.279064 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" event={"ID":"9bfe47cf-ef70-4778-a1b8-1f2847c2cc09","Type":"ContainerStarted","Data":"73304b85c7e45c588b61bf92690a5f2ced7d9f38d65a741985f289f2c91ebbab"} Jul 28 16:21:34.284970 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:34.284916 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" event={"ID":"bb4b9915-7f46-44ae-b771-410002dcd01c","Type":"ContainerStarted","Data":"d07b76919d4ba61e79bd96d6d3de4510ab2acb550650c452c913e4afb931f4f2"} Jul 28 16:21:34.285569 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:34.285211 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" Jul 28 16:21:34.292614 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:34.291854 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" Jul 28 16:21:34.302112 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:34.302047 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-r978l" podStartSLOduration=1.041677529 podStartE2EDuration="2.302025424s" totalImagesPullingTime="1.260347895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:34.302005301 +0000 UTC m=+117.964314558" watchObservedRunningTime="2026-07-28 16:21:34.302025424 +0000 UTC m=+117.964334679" Jul 28 16:21:35.095082 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.095027 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:35.153106 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.153072 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-s7txq"] Jul 28 16:21:35.156710 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.156685 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.159710 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.159685 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 16:21:35.159867 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.159685 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-swsth\"" Jul 28 16:21:35.159867 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.159749 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 16:21:35.160096 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.160073 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 16:21:35.160242 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.160108 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 16:21:35.160242 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.160072 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 16:21:35.169266 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.169242 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-s7txq"] Jul 28 16:21:35.175185 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.175161 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:35.176986 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.176962 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.177102 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.177029 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvg2v\" (UniqueName: \"kubernetes.io/projected/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-kube-api-access-vvg2v\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.177166 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.177144 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.177228 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.177185 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.277596 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.277560 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.277856 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.277627 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvg2v\" (UniqueName: \"kubernetes.io/projected/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-kube-api-access-vvg2v\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.277856 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.277674 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.277856 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.277717 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.277856 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:35.277835 2549 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 16:21:35.278075 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:35.277893 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-prometheus-operator-tls podName:32b34ba7-1f89-4a51-9010-a08cf13ee4b7 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:35.777875731 +0000 UTC m=+119.440184966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-s7txq" (UID: "32b34ba7-1f89-4a51-9010-a08cf13ee4b7") : secret "prometheus-operator-tls" not found Jul 28 16:21:35.278417 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.278391 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.280503 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.280482 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.288597 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.288572 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvg2v\" (UniqueName: \"kubernetes.io/projected/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-kube-api-access-vvg2v\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.483184 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.483129 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:35.781529 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.781432 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.784319 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.784264 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32b34ba7-1f89-4a51-9010-a08cf13ee4b7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-s7txq\" (UID: \"32b34ba7-1f89-4a51-9010-a08cf13ee4b7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:35.947962 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:35.947926 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:36.018811 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:36.018751 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:36.067835 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:36.067747 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" Jul 28 16:21:38.024265 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:38.024237 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-s7txq"] Jul 28 16:21:38.028057 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:38.028002 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b34ba7_1f89_4a51_9010_a08cf13ee4b7.slice/crio-38a194cfd0cf41e4df9cca4730028c577c2e4341ab93fd9d8fcb187d538fc360 WatchSource:0}: Error finding container 38a194cfd0cf41e4df9cca4730028c577c2e4341ab93fd9d8fcb187d538fc360: Status 404 returned error can't find the container with id 38a194cfd0cf41e4df9cca4730028c577c2e4341ab93fd9d8fcb187d538fc360 Jul 28 16:21:38.299091 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:38.299059 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" event={"ID":"32b34ba7-1f89-4a51-9010-a08cf13ee4b7","Type":"ContainerStarted","Data":"38a194cfd0cf41e4df9cca4730028c577c2e4341ab93fd9d8fcb187d538fc360"} Jul 28 16:21:38.300629 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:38.300595 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mlmm" event={"ID":"e78c507b-e4dd-492a-abfc-bbc2c9148d81","Type":"ContainerStarted","Data":"5656876cd0565919d48da6b63aa13280b80138d8103355a0d9cad6c73fb411ae"} Jul 28 16:21:38.301962 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:38.301935 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" event={"ID":"9bfe47cf-ef70-4778-a1b8-1f2847c2cc09","Type":"ContainerStarted","Data":"c46c96942ef0537c82364c532a6ab01312bf04816085c5666bc0c57fab39d8b2"} Jul 28 16:21:38.318916 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:38.318871 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c988945d4-pzzvt" podStartSLOduration=0.989946883 podStartE2EDuration="6.318857397s" totalImagesPullingTime="5.328910514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:38.317530632 +0000 UTC m=+121.979839886" watchObservedRunningTime="2026-07-28 16:21:38.318857397 +0000 UTC m=+121.981166632" Jul 28 16:21:38.779221 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:38.779187 2549 scope.go:117] "RemoveContainer" containerID="1668c5cb2680c49cb99ec5df30ee7f3e3eda0aa352cb8f0a8b8cc11a3a5e5efd" Jul 28 16:21:38.779450 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:38.779419 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-npccl_openshift-console-operator(5e8b4d7a-6c66-449e-86a7-b9579a311364)\"" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" podUID="5e8b4d7a-6c66-449e-86a7-b9579a311364" Jul 28 16:21:39.503669 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:39.503635 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:39.603710 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:39.603671 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:39.704305 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:39.704265 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:39.804832 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:39.804732 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:40.310333 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:40.310284 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" event={"ID":"32b34ba7-1f89-4a51-9010-a08cf13ee4b7","Type":"ContainerStarted","Data":"a1dda6bd9c3e891326776c85d95d8ecbeb6d1db8a966ea89c1b80e55e0a977b5"} Jul 28 16:21:42.319259 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:42.319213 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" event={"ID":"32b34ba7-1f89-4a51-9010-a08cf13ee4b7","Type":"ContainerStarted","Data":"2c6f51d53429d7ae1235a8380a9b3babb725f43a99e7f6319276a811de135673"} Jul 28 16:21:42.321471 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:42.321435 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mlmm" event={"ID":"e78c507b-e4dd-492a-abfc-bbc2c9148d81","Type":"ContainerStarted","Data":"ea24cc7b981cf150e79bb1cbb42ee52e96896f78a7335621dc525234a43d1fb1"} Jul 28 16:21:42.339228 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:42.339175 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-s7txq" podStartSLOduration=5.882312687 podStartE2EDuration="7.339156357s" totalImagesPullingTime="1.45684367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:21:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:42.338024091 +0000 UTC m=+126.000333361" watchObservedRunningTime="2026-07-28 16:21:42.339156357 +0000 UTC m=+126.001465614" Jul 28 16:21:44.270133 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.270093 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:44.511022 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.510983 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:44.559220 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.559141 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nr7m7"] Jul 28 16:21:44.582573 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.582538 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.585030 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.585007 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 16:21:44.586044 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.586002 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nmh5b\"" Jul 28 16:21:44.586717 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.586698 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 16:21:44.587259 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.587241 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 16:21:44.634021 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.633980 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:44.663741 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.663693 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-wtmp\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.663941 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.663756 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/134c3be6-211f-4c27-9c7b-40beed00fb56-metrics-client-ca\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.663941 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.663805 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.663941 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.663860 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/134c3be6-211f-4c27-9c7b-40beed00fb56-sys\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.663941 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.663916 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-tls\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.664145 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.663945 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-accelerators-collector-config\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.664145 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.664031 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qwwb\" (UniqueName: \"kubernetes.io/projected/134c3be6-211f-4c27-9c7b-40beed00fb56-kube-api-access-9qwwb\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.664145 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.664076 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-textfile\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.664269 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.664153 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/134c3be6-211f-4c27-9c7b-40beed00fb56-root\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.729829 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.729760 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:44.764946 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.764904 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-wtmp\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.764963 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/134c3be6-211f-4c27-9c7b-40beed00fb56-metrics-client-ca\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.764993 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765051 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/134c3be6-211f-4c27-9c7b-40beed00fb56-sys\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765105 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-wtmp\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765321 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765163 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-tls\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765321 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765193 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-accelerators-collector-config\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765321 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:44.765266 2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 16:21:44.765468 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:21:44.765339 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-tls podName:134c3be6-211f-4c27-9c7b-40beed00fb56 nodeName:}" failed. No retries permitted until 2026-07-28 16:21:45.265319714 +0000 UTC m=+128.927628971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-tls") pod "node-exporter-nr7m7" (UID: "134c3be6-211f-4c27-9c7b-40beed00fb56") : secret "node-exporter-tls" not found Jul 28 16:21:44.765468 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765372 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qwwb\" (UniqueName: \"kubernetes.io/projected/134c3be6-211f-4c27-9c7b-40beed00fb56-kube-api-access-9qwwb\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765468 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765409 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-textfile\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765632 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765476 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/134c3be6-211f-4c27-9c7b-40beed00fb56-root\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765632 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765573 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/134c3be6-211f-4c27-9c7b-40beed00fb56-root\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765752 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765709 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/134c3be6-211f-4c27-9c7b-40beed00fb56-metrics-client-ca\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765752 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765741 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-accelerators-collector-config\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.765891 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.765822 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/134c3be6-211f-4c27-9c7b-40beed00fb56-sys\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.766191 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.766164 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-textfile\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.768027 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.768005 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.776277 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.776248 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qwwb\" (UniqueName: \"kubernetes.io/projected/134c3be6-211f-4c27-9c7b-40beed00fb56-kube-api-access-9qwwb\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:44.826462 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.826376 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:44.926990 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:44.926949 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:45.026630 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.026608 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:45.129032 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.128919 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:45.268914 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.268869 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-tls\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:45.271205 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.271183 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/134c3be6-211f-4c27-9c7b-40beed00fb56-node-exporter-tls\") pod \"node-exporter-nr7m7\" (UID: \"134c3be6-211f-4c27-9c7b-40beed00fb56\") " pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:45.333407 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.333379 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mlmm" event={"ID":"e78c507b-e4dd-492a-abfc-bbc2c9148d81","Type":"ContainerStarted","Data":"309be5dd046f83694dd1cdfb795de1826205ba451527393a7b240489c24d2c3a"} Jul 28 16:21:45.353325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.353275 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6mlmm" podStartSLOduration=33.66358668 podStartE2EDuration="46.35326022s" totalImagesPullingTime="12.68967354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:20:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:45.352249698 +0000 UTC m=+129.014558968" watchObservedRunningTime="2026-07-28 16:21:45.35326022 +0000 UTC m=+129.015569476" Jul 28 16:21:45.493907 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.493874 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nr7m7" Jul 28 16:21:45.504961 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:45.504884 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134c3be6_211f_4c27_9c7b_40beed00fb56.slice/crio-6f355058e9ae880a2f8f29840c134354740083ed3776369a4ec1e138345c82e7 WatchSource:0}: Error finding container 6f355058e9ae880a2f8f29840c134354740083ed3776369a4ec1e138345c82e7: Status 404 returned error can't find the container with id 6f355058e9ae880a2f8f29840c134354740083ed3776369a4ec1e138345c82e7 Jul 28 16:21:45.523342 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.523301 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:45.620858 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.620797 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:45.621102 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.621028 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 16:21:45.625496 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.625476 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.628728 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.628703 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 16:21:45.628870 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.628737 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 16:21:45.628870 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.628834 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h8xk7\"" Jul 28 16:21:45.628870 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.628846 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 16:21:45.628870 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.628852 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 16:21:45.629085 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.628848 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 16:21:45.629085 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.628924 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 16:21:45.629085 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.628993 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 16:21:45.629202 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.629185 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 16:21:45.629245 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.629185 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 16:21:45.640883 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.640857 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 16:21:45.672326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672289 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-web-config\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672326 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-out\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672544 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672359 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672544 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672378 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672544 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672427 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672544 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672469 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672544 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672516 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-volume\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672706 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672561 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672706 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672579 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672706 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672642 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672706 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672706 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672701 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk8qh\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-kube-api-access-gk8qh\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.672890 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.672730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.742652 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.742611 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:45.773475 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773382 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-volume\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773475 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773461 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773484 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773528 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773560 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773601 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk8qh\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-kube-api-access-gk8qh\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773645 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773952 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773683 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-web-config\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773952 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773712 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-out\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773952 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773761 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773952 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773804 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773952 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773830 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.773952 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.773859 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.774626 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.774588 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.775253 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.775228 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.776663 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.776640 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.777250 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.776955 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-out\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.777250 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.777099 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.777460 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.777438 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.777862 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.777837 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.777962 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.777900 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-volume\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.778024 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.777972 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.778024 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.778010 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-web-config\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.778860 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.778837 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.779022 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.779007 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.782733 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.782710 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk8qh\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-kube-api-access-gk8qh\") pod \"alertmanager-main-0\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:45.939167 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:45.939124 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:21:46.109000 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.108966 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 16:21:46.308736 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:46.308667 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7ee4eb_9d4c_4232_ad51_bd2a286f248e.slice/crio-bed2de6c3f8dda2d409f9f48e2f46904894ca36101eb61cf3b3afc2aea59d168 WatchSource:0}: Error finding container bed2de6c3f8dda2d409f9f48e2f46904894ca36101eb61cf3b3afc2aea59d168: Status 404 returned error can't find the container with id bed2de6c3f8dda2d409f9f48e2f46904894ca36101eb61cf3b3afc2aea59d168 Jul 28 16:21:46.337484 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.337444 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerStarted","Data":"bed2de6c3f8dda2d409f9f48e2f46904894ca36101eb61cf3b3afc2aea59d168"} Jul 28 16:21:46.338523 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.338500 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nr7m7" event={"ID":"134c3be6-211f-4c27-9c7b-40beed00fb56","Type":"ContainerStarted","Data":"6f355058e9ae880a2f8f29840c134354740083ed3776369a4ec1e138345c82e7"} Jul 28 16:21:46.540416 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.540385 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79d79494f5-7ghbp"] Jul 28 16:21:46.543941 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.543922 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.546268 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.546242 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 16:21:46.546371 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.546264 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 16:21:46.546371 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.546242 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2703rsjee3963\"" Jul 28 16:21:46.546371 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.546264 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gknjv\"" Jul 28 16:21:46.546371 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.546242 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 16:21:46.546371 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.546366 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 16:21:46.546583 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.546271 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 16:21:46.558100 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.558073 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79d79494f5-7ghbp"] Jul 28 16:21:46.581807 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.581732 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.581903 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.581843 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04420891-1256-42ed-8315-c9c88d2c0512-metrics-client-ca\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.581903 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.581871 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtnfw\" (UniqueName: \"kubernetes.io/projected/04420891-1256-42ed-8315-c9c88d2c0512-kube-api-access-qtnfw\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.581903 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.581893 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.581996 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.581913 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.581996 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.581934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-tls\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.582060 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.582005 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-grpc-tls\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.582060 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.582037 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.683040 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.683012 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.683177 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.683060 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.683243 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.683177 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:21:46.683288 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.683241 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04420891-1256-42ed-8315-c9c88d2c0512-metrics-client-ca\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.683288 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.683261 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtnfw\" (UniqueName: \"kubernetes.io/projected/04420891-1256-42ed-8315-c9c88d2c0512-kube-api-access-qtnfw\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.683384 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.683287 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.683384 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.683316 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.683497 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.683395 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-tls\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.683497 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.683450 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-grpc-tls\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.684140 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.684072 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04420891-1256-42ed-8315-c9c88d2c0512-metrics-client-ca\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.685993 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.685969 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-grpc-tls\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.686108 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.685971 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8117b8-9615-4fbd-bd55-ced89f5b2127-metrics-certs\") pod \"network-metrics-daemon-h957s\" (UID: \"6f8117b8-9615-4fbd-bd55-ced89f5b2127\") " pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:21:46.686108 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.686028 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.686108 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.686081 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.686267 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.686185 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-tls\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.686267 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.686192 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.686477 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.686461 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04420891-1256-42ed-8315-c9c88d2c0512-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.691720 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.691700 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtnfw\" (UniqueName: \"kubernetes.io/projected/04420891-1256-42ed-8315-c9c88d2c0512-kube-api-access-qtnfw\") pod \"thanos-querier-79d79494f5-7ghbp\" (UID: \"04420891-1256-42ed-8315-c9c88d2c0512\") " pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.705671 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.705652 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mdnvx\"" Jul 28 16:21:46.713736 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.713712 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h957s" Jul 28 16:21:46.853209 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.853139 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:46.857028 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.857001 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h957s"] Jul 28 16:21:46.862910 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:46.862877 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8117b8_9615_4fbd_bd55_ced89f5b2127.slice/crio-86fd7835476b513829e41b9f3d393ef4209f52fafa01ff7811e36b4897f775af WatchSource:0}: Error finding container 86fd7835476b513829e41b9f3d393ef4209f52fafa01ff7811e36b4897f775af: Status 404 returned error can't find the container with id 86fd7835476b513829e41b9f3d393ef4209f52fafa01ff7811e36b4897f775af Jul 28 16:21:46.999880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:46.999850 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79d79494f5-7ghbp"] Jul 28 16:21:47.199598 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:47.199568 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04420891_1256_42ed_8315_c9c88d2c0512.slice/crio-06e214d78a8519aefa37b9c6e0440cd81935eccabf9a32e667cc682811a71aa8 WatchSource:0}: Error finding container 06e214d78a8519aefa37b9c6e0440cd81935eccabf9a32e667cc682811a71aa8: Status 404 returned error can't find the container with id 06e214d78a8519aefa37b9c6e0440cd81935eccabf9a32e667cc682811a71aa8 Jul 28 16:21:47.344143 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:47.344111 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h957s" event={"ID":"6f8117b8-9615-4fbd-bd55-ced89f5b2127","Type":"ContainerStarted","Data":"86fd7835476b513829e41b9f3d393ef4209f52fafa01ff7811e36b4897f775af"} Jul 28 16:21:47.345884 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:47.345765 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerID="4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d" exitCode=0 Jul 28 16:21:47.345884 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:47.345818 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerDied","Data":"4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d"} Jul 28 16:21:47.347684 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:47.347661 2549 generic.go:356] "Generic (PLEG): container finished" podID="134c3be6-211f-4c27-9c7b-40beed00fb56" containerID="c0ef72615646be67738e7237bf860b57cb1f994c0812bc8a69cc945f3104e8e7" exitCode=0 Jul 28 16:21:47.347761 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:47.347722 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nr7m7" event={"ID":"134c3be6-211f-4c27-9c7b-40beed00fb56","Type":"ContainerDied","Data":"c0ef72615646be67738e7237bf860b57cb1f994c0812bc8a69cc945f3104e8e7"} Jul 28 16:21:47.349262 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:47.349171 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" event={"ID":"04420891-1256-42ed-8315-c9c88d2c0512","Type":"ContainerStarted","Data":"06e214d78a8519aefa37b9c6e0440cd81935eccabf9a32e667cc682811a71aa8"} Jul 28 16:21:47.506167 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:47.506144 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:47.606740 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:47.606702 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:47.705161 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:47.705069 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:48.055492 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.055358 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:48.355937 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.355844 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h957s" event={"ID":"6f8117b8-9615-4fbd-bd55-ced89f5b2127","Type":"ContainerStarted","Data":"ab4bcbfb1edfa8508f208f217819c2ae48698b83825583619622e883be5fcbdb"} Jul 28 16:21:48.355937 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.355906 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h957s" event={"ID":"6f8117b8-9615-4fbd-bd55-ced89f5b2127","Type":"ContainerStarted","Data":"afb4ab7516b49440675bcb5eae959eec81b25e082ba7d0b10555c92adbcca0ea"} Jul 28 16:21:48.358815 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.358771 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nr7m7" event={"ID":"134c3be6-211f-4c27-9c7b-40beed00fb56","Type":"ContainerStarted","Data":"d44e0fd15c8ce8a6331eac1c8ddc04da0316133b3a8643e3a1cde3709d754259"} Jul 28 16:21:48.358938 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.358844 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nr7m7" event={"ID":"134c3be6-211f-4c27-9c7b-40beed00fb56","Type":"ContainerStarted","Data":"34ee5918fa986cde09b41610b67327b526eefa93397e4384c383dc008e646d22"} Jul 28 16:21:48.375848 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.375805 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h957s" podStartSLOduration=130.45933906 podStartE2EDuration="2m11.37577079s" totalImagesPullingTime="916.43173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:48.374736009 +0000 UTC m=+132.037045267" watchObservedRunningTime="2026-07-28 16:21:48.37577079 +0000 UTC m=+132.038080049" Jul 28 16:21:48.406882 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.406834 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nr7m7" podStartSLOduration=3.49544527 podStartE2EDuration="4.406818704s" totalImagesPullingTime="847.949064ms" totalInitContainerRuntime="63.42437ms" isStatefulPod=true podCreationTimestamp="2026-07-28 16:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:48.405118792 +0000 UTC m=+132.067428062" watchObservedRunningTime="2026-07-28 16:21:48.406818704 +0000 UTC m=+132.069127961" Jul 28 16:21:48.524927 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.524884 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:48.622282 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.622206 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:48.723088 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.723053 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:48.964487 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.964455 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cb776bcdf-9pgfh"] Jul 28 16:21:48.968002 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.967973 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:48.970127 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.970103 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 16:21:48.970969 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.970824 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 16:21:48.971089 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.970982 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 16:21:48.971089 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.971046 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 16:21:48.971226 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.971087 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6oetv3bduulv3\"" Jul 28 16:21:48.971226 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.971187 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tzqv2\"" Jul 28 16:21:48.977564 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:48.977542 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cb776bcdf-9pgfh"] Jul 28 16:21:49.106381 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.106347 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqbz\" (UniqueName: \"kubernetes.io/projected/ac3ad3ef-1194-4345-9191-ab769939e8ee-kube-api-access-hgqbz\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.106555 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.106393 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac3ad3ef-1194-4345-9191-ab769939e8ee-client-ca-bundle\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.106555 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.106424 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac3ad3ef-1194-4345-9191-ab769939e8ee-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.106555 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.106448 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac3ad3ef-1194-4345-9191-ab769939e8ee-audit-log\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.106555 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.106485 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac3ad3ef-1194-4345-9191-ab769939e8ee-secret-metrics-server-tls\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.106736 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.106589 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac3ad3ef-1194-4345-9191-ab769939e8ee-metrics-server-audit-profiles\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.106736 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.106633 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac3ad3ef-1194-4345-9191-ab769939e8ee-secret-metrics-server-client-certs\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.207973 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.207929 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac3ad3ef-1194-4345-9191-ab769939e8ee-metrics-server-audit-profiles\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.208119 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.207983 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac3ad3ef-1194-4345-9191-ab769939e8ee-secret-metrics-server-client-certs\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.208119 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.208047 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqbz\" (UniqueName: \"kubernetes.io/projected/ac3ad3ef-1194-4345-9191-ab769939e8ee-kube-api-access-hgqbz\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.208119 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.208086 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac3ad3ef-1194-4345-9191-ab769939e8ee-client-ca-bundle\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.208295 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.208120 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac3ad3ef-1194-4345-9191-ab769939e8ee-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.208295 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.208147 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac3ad3ef-1194-4345-9191-ab769939e8ee-audit-log\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.208295 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.208188 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac3ad3ef-1194-4345-9191-ab769939e8ee-secret-metrics-server-tls\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.208678 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.208643 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac3ad3ef-1194-4345-9191-ab769939e8ee-audit-log\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.208974 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.208921 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac3ad3ef-1194-4345-9191-ab769939e8ee-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.209100 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.209087 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac3ad3ef-1194-4345-9191-ab769939e8ee-metrics-server-audit-profiles\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.210964 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.210921 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac3ad3ef-1194-4345-9191-ab769939e8ee-secret-metrics-server-client-certs\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.211136 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.211103 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac3ad3ef-1194-4345-9191-ab769939e8ee-client-ca-bundle\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.211575 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.211553 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac3ad3ef-1194-4345-9191-ab769939e8ee-secret-metrics-server-tls\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.217542 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.217518 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqbz\" (UniqueName: \"kubernetes.io/projected/ac3ad3ef-1194-4345-9191-ab769939e8ee-kube-api-access-hgqbz\") pod \"metrics-server-7cb776bcdf-9pgfh\" (UID: \"ac3ad3ef-1194-4345-9191-ab769939e8ee\") " pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.281144 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.281120 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:21:49.294325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.294298 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:49.547973 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.547944 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cb776bcdf-9pgfh"] Jul 28 16:21:49.552053 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:49.552018 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3ad3ef_1194_4345_9191_ab769939e8ee.slice/crio-797dbec186a1b8f992b031faec95b0bc316c0099d04b57fecf2d0bf0bae73ba2 WatchSource:0}: Error finding container 797dbec186a1b8f992b031faec95b0bc316c0099d04b57fecf2d0bf0bae73ba2: Status 404 returned error can't find the container with id 797dbec186a1b8f992b031faec95b0bc316c0099d04b57fecf2d0bf0bae73ba2 Jul 28 16:21:49.777499 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.777428 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-869848f696-mrgjt"] Jul 28 16:21:49.780886 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.780870 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:49.783270 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.783246 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 16:21:49.783385 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.783276 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 16:21:49.783385 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.783285 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 16:21:49.783385 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.783293 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 16:21:49.783385 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.783246 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 16:21:49.783603 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.783419 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-m969b\"" Jul 28 16:21:49.788855 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.788836 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 16:21:49.794879 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.794860 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-869848f696-mrgjt"] Jul 28 16:21:49.907720 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.907696 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:49.914684 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.914663 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb73e0bb-ff66-4118-8904-d0685d47a806-serving-certs-ca-bundle\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:49.914796 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.914706 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-federate-client-tls\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:49.914796 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.914736 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-telemeter-client-tls\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:49.914875 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.914858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-secret-telemeter-client\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:49.914937 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.914924 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv7gj\" (UniqueName: \"kubernetes.io/projected/cb73e0bb-ff66-4118-8904-d0685d47a806-kube-api-access-sv7gj\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:49.914975 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.914953 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb73e0bb-ff66-4118-8904-d0685d47a806-metrics-client-ca\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:49.915024 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.914979 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb73e0bb-ff66-4118-8904-d0685d47a806-telemeter-trusted-ca-bundle\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:49.915024 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:49.914997 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.015914 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.015891 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb73e0bb-ff66-4118-8904-d0685d47a806-metrics-client-ca\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.015991 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.015920 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb73e0bb-ff66-4118-8904-d0685d47a806-telemeter-trusted-ca-bundle\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.015991 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.015944 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.015991 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.015970 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb73e0bb-ff66-4118-8904-d0685d47a806-serving-certs-ca-bundle\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.016155 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.015993 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-federate-client-tls\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.016155 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.016011 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-telemeter-client-tls\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.016251 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.016173 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-secret-telemeter-client\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.016304 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.016247 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv7gj\" (UniqueName: \"kubernetes.io/projected/cb73e0bb-ff66-4118-8904-d0685d47a806-kube-api-access-sv7gj\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.016719 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.016674 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb73e0bb-ff66-4118-8904-d0685d47a806-metrics-client-ca\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.016719 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.016711 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb73e0bb-ff66-4118-8904-d0685d47a806-serving-certs-ca-bundle\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.016954 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.016929 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb73e0bb-ff66-4118-8904-d0685d47a806-telemeter-trusted-ca-bundle\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.018507 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.018480 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-telemeter-client-tls\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.018573 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.018537 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.018799 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.018761 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-federate-client-tls\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.018975 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.018955 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb73e0bb-ff66-4118-8904-d0685d47a806-secret-telemeter-client\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.027162 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.027138 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv7gj\" (UniqueName: \"kubernetes.io/projected/cb73e0bb-ff66-4118-8904-d0685d47a806-kube-api-access-sv7gj\") pod \"telemeter-client-869848f696-mrgjt\" (UID: \"cb73e0bb-ff66-4118-8904-d0685d47a806\") " pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.091303 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.091254 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" Jul 28 16:21:50.277918 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.277833 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-869848f696-mrgjt"] Jul 28 16:21:50.369907 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.369820 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" event={"ID":"ac3ad3ef-1194-4345-9191-ab769939e8ee","Type":"ContainerStarted","Data":"797dbec186a1b8f992b031faec95b0bc316c0099d04b57fecf2d0bf0bae73ba2"} Jul 28 16:21:50.373968 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.373680 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerStarted","Data":"2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43"} Jul 28 16:21:50.373968 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.373766 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerStarted","Data":"8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0"} Jul 28 16:21:50.373968 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.373835 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerStarted","Data":"bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab"} Jul 28 16:21:50.373968 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.373877 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerStarted","Data":"5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c"} Jul 28 16:21:50.373968 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.373917 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerStarted","Data":"83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697"} Jul 28 16:21:50.376565 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.376535 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" event={"ID":"04420891-1256-42ed-8315-c9c88d2c0512","Type":"ContainerStarted","Data":"0de0bdf3b55c41a8682acb5df3c7d4a1a9f8d293c51b4434654dc73b7786c07c"} Jul 28 16:21:50.376691 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.376611 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" event={"ID":"04420891-1256-42ed-8315-c9c88d2c0512","Type":"ContainerStarted","Data":"5fcbcf51344b835b1efaedeec9caacdce06ac456c2d488b643971fd5a2b01bc5"} Jul 28 16:21:50.376691 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.376656 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" event={"ID":"04420891-1256-42ed-8315-c9c88d2c0512","Type":"ContainerStarted","Data":"9c6b678acba5155e4625a6639ddadc9b50cddbaa558b3ee7fb470799ab1ed743"} Jul 28 16:21:50.395046 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:21:50.395020 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb73e0bb_ff66_4118_8904_d0685d47a806.slice/crio-63d816e7d7c53b501def7f050f5cc7c40f4ddce61ce6d29fd505f2a3506643b5 WatchSource:0}: Error finding container 63d816e7d7c53b501def7f050f5cc7c40f4ddce61ce6d29fd505f2a3506643b5: Status 404 returned error can't find the container with id 63d816e7d7c53b501def7f050f5cc7c40f4ddce61ce6d29fd505f2a3506643b5 Jul 28 16:21:50.831002 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:50.830949 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:51.385853 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:51.385747 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerStarted","Data":"fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8"} Jul 28 16:21:51.390112 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:51.390069 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" event={"ID":"04420891-1256-42ed-8315-c9c88d2c0512","Type":"ContainerStarted","Data":"bbba6c8f482ddb14b4cc94af4b8bbefcfb14765fb8571e3f7dfd0d78b1ff694c"} Jul 28 16:21:51.390296 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:51.390156 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" event={"ID":"04420891-1256-42ed-8315-c9c88d2c0512","Type":"ContainerStarted","Data":"a75c2807025d027aaafd7a8a533e5dbb4ac4b9a5bb12d09cfa8eb92b570e55d9"} Jul 28 16:21:51.390296 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:51.390196 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" event={"ID":"04420891-1256-42ed-8315-c9c88d2c0512","Type":"ContainerStarted","Data":"73af84fb87b60b42a8b3a0a850339a18ed8d8ef42d5e755bf57a98106007379c"} Jul 28 16:21:51.390296 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:51.390238 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:51.392288 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:51.392241 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" event={"ID":"ac3ad3ef-1194-4345-9191-ab769939e8ee","Type":"ContainerStarted","Data":"c46cf5587f7d4f7940fb6b6b2d142cdb9eef4f90dd8788db0ece439f89ca069d"} Jul 28 16:21:51.393663 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:51.393626 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" event={"ID":"cb73e0bb-ff66-4118-8904-d0685d47a806","Type":"ContainerStarted","Data":"63d816e7d7c53b501def7f050f5cc7c40f4ddce61ce6d29fd505f2a3506643b5"} Jul 28 16:21:51.418290 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:51.417955 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.201916549 podStartE2EDuration="6.417932692s" totalImagesPullingTime="3.199179271s" totalInitContainerRuntime="16.836872ms" isStatefulPod=false podCreationTimestamp="2026-07-28 16:21:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:51.414330238 +0000 UTC m=+135.076639508" watchObservedRunningTime="2026-07-28 16:21:51.417932692 +0000 UTC m=+135.080241954" Jul 28 16:21:51.441070 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:51.441002 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" podStartSLOduration=2.376071447 podStartE2EDuration="5.440979659s" totalImagesPullingTime="3.064908212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:21:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:51.439579398 +0000 UTC m=+135.101888678" watchObservedRunningTime="2026-07-28 16:21:51.440979659 +0000 UTC m=+135.103288916" Jul 28 16:21:53.408646 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:53.408606 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" event={"ID":"cb73e0bb-ff66-4118-8904-d0685d47a806","Type":"ContainerStarted","Data":"72caf3fb5471415b3a4b05552a11da0c1f6482cc64e29fdc1eab724dccc44ee0"} Jul 28 16:21:53.409057 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:53.408667 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" event={"ID":"cb73e0bb-ff66-4118-8904-d0685d47a806","Type":"ContainerStarted","Data":"f8b2f4e9e518905e1255f785534cbd805453bf530f2dd250e023a257c0ff0cf3"} Jul 28 16:21:53.409057 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:53.408686 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" event={"ID":"cb73e0bb-ff66-4118-8904-d0685d47a806","Type":"ContainerStarted","Data":"2850add7455a02bfb52e59e8d293280f013776b83e02307a13f3073b967b8e8e"} Jul 28 16:21:53.431130 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:53.431072 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" podStartSLOduration=3.926048487 podStartE2EDuration="5.431054632s" totalImagesPullingTime="1.505006145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:51.460017357 +0000 UTC m=+135.122326614" watchObservedRunningTime="2026-07-28 16:21:53.431054632 +0000 UTC m=+137.093363888" Jul 28 16:21:53.431383 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:53.431353 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-869848f696-mrgjt" podStartSLOduration=2.331698233 podStartE2EDuration="4.431345345s" totalImagesPullingTime="2.099647112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:53.429424334 +0000 UTC m=+137.091733590" watchObservedRunningTime="2026-07-28 16:21:53.431345345 +0000 UTC m=+137.093654601" Jul 28 16:21:53.779042 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:53.779013 2549 scope.go:117] "RemoveContainer" containerID="1668c5cb2680c49cb99ec5df30ee7f3e3eda0aa352cb8f0a8b8cc11a3a5e5efd" Jul 28 16:21:54.414071 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:54.414038 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:21:54.414550 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:54.414168 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" event={"ID":"5e8b4d7a-6c66-449e-86a7-b9579a311364","Type":"ContainerStarted","Data":"d17e454279785de0be2acf9313423e184e90e05f0b41f12abac1630055a0f03d"} Jul 28 16:21:54.414635 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:54.414603 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:21:54.433501 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:54.433446 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" podStartSLOduration=56.248628848 podStartE2EDuration="58.433429547s" totalImagesPullingTime="2.184800699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:21:54.432575517 +0000 UTC m=+138.094884775" watchObservedRunningTime="2026-07-28 16:21:54.433429547 +0000 UTC m=+138.095738810" Jul 28 16:21:54.853631 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:54.853601 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-npccl" Jul 28 16:21:55.061906 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:55.061871 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:55.159733 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:55.159639 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:55.234828 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:55.234761 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:55.537160 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:55.537122 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:55.638532 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:55.638500 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:55.737538 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:55.737505 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:55.838018 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:55.837928 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:56.752773 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:56.752732 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:56.914120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:56.914087 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:56.983646 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:56.983612 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:57.384623 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:57.384583 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:21:57.407964 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:57.407939 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79d79494f5-7ghbp" Jul 28 16:21:57.486470 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:21:57.486424 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:00.151985 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:00.151940 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:00.224186 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:00.224152 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:02.899189 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:02.899155 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:02.976595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:02.976560 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:05.379313 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.379277 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5477456fc5-dxthw"] Jul 28 16:22:05.379662 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:22:05.379505 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5477456fc5-dxthw" podUID="40727c58-bc71-49a5-8e0e-ab71f1537b58" Jul 28 16:22:05.456549 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.456520 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:22:05.471474 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.471431 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:05.571723 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.571683 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:05.837004 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.836970 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:22:05.964564 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.964533 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-certificates\") pod \"40727c58-bc71-49a5-8e0e-ab71f1537b58\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " Jul 28 16:22:05.964748 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.964571 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57ndt\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-kube-api-access-57ndt\") pod \"40727c58-bc71-49a5-8e0e-ab71f1537b58\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " Jul 28 16:22:05.964748 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.964596 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-installation-pull-secrets\") pod \"40727c58-bc71-49a5-8e0e-ab71f1537b58\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " Jul 28 16:22:05.964748 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.964641 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-bound-sa-token\") pod \"40727c58-bc71-49a5-8e0e-ab71f1537b58\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " Jul 28 16:22:05.964748 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.964672 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-image-registry-private-configuration\") pod \"40727c58-bc71-49a5-8e0e-ab71f1537b58\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " Jul 28 16:22:05.964748 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.964697 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-trusted-ca\") pod \"40727c58-bc71-49a5-8e0e-ab71f1537b58\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " Jul 28 16:22:05.964748 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.964722 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40727c58-bc71-49a5-8e0e-ab71f1537b58-ca-trust-extracted\") pod \"40727c58-bc71-49a5-8e0e-ab71f1537b58\" (UID: \"40727c58-bc71-49a5-8e0e-ab71f1537b58\") " Jul 28 16:22:05.965099 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.964921 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "40727c58-bc71-49a5-8e0e-ab71f1537b58" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:22:05.965099 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.965078 2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-certificates\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:05.965212 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.965134 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40727c58-bc71-49a5-8e0e-ab71f1537b58-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "40727c58-bc71-49a5-8e0e-ab71f1537b58" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:22:05.965526 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.965494 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "40727c58-bc71-49a5-8e0e-ab71f1537b58" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:22:05.967096 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.967066 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "40727c58-bc71-49a5-8e0e-ab71f1537b58" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:22:05.967096 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.967087 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "40727c58-bc71-49a5-8e0e-ab71f1537b58" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:22:05.967282 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.967168 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-kube-api-access-57ndt" (OuterVolumeSpecName: "kube-api-access-57ndt") pod "40727c58-bc71-49a5-8e0e-ab71f1537b58" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58"). InnerVolumeSpecName "kube-api-access-57ndt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:22:05.967342 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:05.967294 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "40727c58-bc71-49a5-8e0e-ab71f1537b58" (UID: "40727c58-bc71-49a5-8e0e-ab71f1537b58"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:22:06.037898 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.037868 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7848b7c496-gkwl6"] Jul 28 16:22:06.055636 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.055611 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7848b7c496-gkwl6"] Jul 28 16:22:06.055762 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.055721 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.058284 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.058249 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 16:22:06.058450 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.058428 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rphv6\"" Jul 28 16:22:06.058450 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.058254 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 16:22:06.058616 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.058280 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 16:22:06.058616 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.058384 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 16:22:06.058616 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.058322 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 16:22:06.058616 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.058386 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 16:22:06.058616 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.058404 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 16:22:06.066006 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.065988 2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-image-registry-private-configuration\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:06.066006 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.066006 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40727c58-bc71-49a5-8e0e-ab71f1537b58-trusted-ca\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:06.066120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.066018 2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40727c58-bc71-49a5-8e0e-ab71f1537b58-ca-trust-extracted\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:06.066120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.066032 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57ndt\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-kube-api-access-57ndt\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:06.066120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.066043 2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40727c58-bc71-49a5-8e0e-ab71f1537b58-installation-pull-secrets\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:06.066120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.066051 2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-bound-sa-token\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:06.167291 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.167213 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-serving-cert\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.167291 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.167271 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4qp2\" (UniqueName: \"kubernetes.io/projected/562d5d9f-90f0-4187-ba00-ecd20bf2e717-kube-api-access-k4qp2\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.167537 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.167352 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-oauth-serving-cert\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.167537 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.167383 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-config\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.167537 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.167406 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-service-ca\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.167537 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.167482 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-oauth-config\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.268580 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.268538 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qp2\" (UniqueName: \"kubernetes.io/projected/562d5d9f-90f0-4187-ba00-ecd20bf2e717-kube-api-access-k4qp2\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.268852 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.268596 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-oauth-serving-cert\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.268852 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.268626 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-config\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.268852 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.268653 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-service-ca\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.268852 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.268694 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-oauth-config\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.268852 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.268763 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-serving-cert\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.269533 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.269506 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-service-ca\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.269653 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.269531 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-config\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.269653 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.269531 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-oauth-serving-cert\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.271229 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.271198 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-serving-cert\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.271328 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.271237 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-oauth-config\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.278045 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.278012 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4qp2\" (UniqueName: \"kubernetes.io/projected/562d5d9f-90f0-4187-ba00-ecd20bf2e717-kube-api-access-k4qp2\") pod \"console-7848b7c496-gkwl6\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.366019 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.365969 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:06.461197 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.461173 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5477456fc5-dxthw" Jul 28 16:22:06.496014 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.495979 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5477456fc5-dxthw"] Jul 28 16:22:06.500794 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.500749 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5477456fc5-dxthw"] Jul 28 16:22:06.523724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.523693 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7848b7c496-gkwl6"] Jul 28 16:22:06.526715 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:22:06.526695 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562d5d9f_90f0_4187_ba00_ecd20bf2e717.slice/crio-aa1c2a2e6c8d8daf94d27b53237726298675838436f60b635791191e97c023c8 WatchSource:0}: Error finding container aa1c2a2e6c8d8daf94d27b53237726298675838436f60b635791191e97c023c8: Status 404 returned error can't find the container with id aa1c2a2e6c8d8daf94d27b53237726298675838436f60b635791191e97c023c8 Jul 28 16:22:06.672704 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.672675 2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40727c58-bc71-49a5-8e0e-ab71f1537b58-registry-tls\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:06.788064 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.788028 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40727c58-bc71-49a5-8e0e-ab71f1537b58" path="/var/lib/kubelet/pods/40727c58-bc71-49a5-8e0e-ab71f1537b58/volumes" Jul 28 16:22:06.956841 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:06.956800 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:07.020052 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:07.020012 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:07.468393 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:07.468348 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7848b7c496-gkwl6" event={"ID":"562d5d9f-90f0-4187-ba00-ecd20bf2e717","Type":"ContainerStarted","Data":"aa1c2a2e6c8d8daf94d27b53237726298675838436f60b635791191e97c023c8"} Jul 28 16:22:09.282015 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:09.281974 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:22:09.282426 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:09.282074 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:22:10.483770 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:10.483732 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7848b7c496-gkwl6" event={"ID":"562d5d9f-90f0-4187-ba00-ecd20bf2e717","Type":"ContainerStarted","Data":"a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed"} Jul 28 16:22:10.504324 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:10.504241 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7848b7c496-gkwl6" podStartSLOduration=0.921052873 podStartE2EDuration="4.504203444s" totalImagesPullingTime="3.583150571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:22:10.503636938 +0000 UTC m=+154.165946218" watchObservedRunningTime="2026-07-28 16:22:10.504203444 +0000 UTC m=+154.166512701" Jul 28 16:22:10.568013 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:10.567980 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:10.634497 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:10.634460 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:11.919052 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:11.919010 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:12.020170 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:12.020138 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:13.081911 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:13.081873 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:13.181498 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:13.181463 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:13.281469 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:13.281435 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:13.352832 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:13.352733 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:13.999603 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:13.999575 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:14.101705 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:14.101663 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:14.246512 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:22:14.246473 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zhqrp" podUID="d143b044-60a2-465f-84e7-9d57a496ca40" Jul 28 16:22:14.499082 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:14.499056 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zhqrp" Jul 28 16:22:14.641612 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:14.641575 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:14.735153 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:14.735106 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:14.994366 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:14.994310 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:15.082480 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.082404 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:15.350770 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.350691 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d8f6c984-mwpp9"] Jul 28 16:22:15.352919 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.352904 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.359991 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.359960 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 16:22:15.367884 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.367855 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d8f6c984-mwpp9"] Jul 28 16:22:15.452870 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.452841 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-serving-cert\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.453027 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.452885 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-trusted-ca-bundle\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.453027 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.452903 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-console-config\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.453027 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.452936 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-oauth-serving-cert\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.453027 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.452983 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm9ps\" (UniqueName: \"kubernetes.io/projected/c37f0602-52ec-49df-bd87-2ac792b70113-kube-api-access-fm9ps\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.453242 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.453064 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-service-ca\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.453242 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.453194 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-oauth-config\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.554374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.554347 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-serving-cert\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.554505 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.554385 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-trusted-ca-bundle\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.554505 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.554401 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-console-config\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.554638 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.554514 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-oauth-serving-cert\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.554638 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.554586 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm9ps\" (UniqueName: \"kubernetes.io/projected/c37f0602-52ec-49df-bd87-2ac792b70113-kube-api-access-fm9ps\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.554638 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.554616 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-service-ca\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.554806 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.554652 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-oauth-config\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.555343 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.555321 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-console-config\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.555454 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.555377 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-oauth-serving-cert\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.555454 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.555377 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-service-ca\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.555569 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.555512 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-trusted-ca-bundle\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.556873 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.556856 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-serving-cert\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.557067 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.557052 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-oauth-config\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.563144 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.563127 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm9ps\" (UniqueName: \"kubernetes.io/projected/c37f0602-52ec-49df-bd87-2ac792b70113-kube-api-access-fm9ps\") pod \"console-74d8f6c984-mwpp9\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.663418 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.663363 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:15.788310 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:15.788277 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d8f6c984-mwpp9"] Jul 28 16:22:15.791182 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:22:15.791157 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37f0602_52ec_49df_bd87_2ac792b70113.slice/crio-e427bf20cbd482cf89ef4e4d15c22c12dabefc8ecd45922545a14e17242a5f56 WatchSource:0}: Error finding container e427bf20cbd482cf89ef4e4d15c22c12dabefc8ecd45922545a14e17242a5f56: Status 404 returned error can't find the container with id e427bf20cbd482cf89ef4e4d15c22c12dabefc8ecd45922545a14e17242a5f56 Jul 28 16:22:16.366330 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:16.366288 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:16.366703 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:16.366356 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:16.370886 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:16.370866 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:16.508144 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:16.508107 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d8f6c984-mwpp9" event={"ID":"c37f0602-52ec-49df-bd87-2ac792b70113","Type":"ContainerStarted","Data":"54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1"} Jul 28 16:22:16.508290 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:16.508166 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d8f6c984-mwpp9" event={"ID":"c37f0602-52ec-49df-bd87-2ac792b70113","Type":"ContainerStarted","Data":"e427bf20cbd482cf89ef4e4d15c22c12dabefc8ecd45922545a14e17242a5f56"} Jul 28 16:22:16.511813 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:16.511789 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:16.555856 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:16.555803 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d8f6c984-mwpp9" podStartSLOduration=1.555770509 podStartE2EDuration="1.555770509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:22:16.533058624 +0000 UTC m=+160.195367881" watchObservedRunningTime="2026-07-28 16:22:16.555770509 +0000 UTC m=+160.218079766" Jul 28 16:22:19.184706 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:19.184678 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:22:19.186964 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:19.186941 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d143b044-60a2-465f-84e7-9d57a496ca40-metrics-tls\") pod \"dns-default-zhqrp\" (UID: \"d143b044-60a2-465f-84e7-9d57a496ca40\") " pod="openshift-dns/dns-default-zhqrp" Jul 28 16:22:19.302172 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:19.302140 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zjnr6\"" Jul 28 16:22:19.310667 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:19.310641 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zhqrp" Jul 28 16:22:19.436712 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:19.436643 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zhqrp"] Jul 28 16:22:19.440643 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:22:19.440615 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd143b044_60a2_465f_84e7_9d57a496ca40.slice/crio-99f3c9ee3cc4dda9e786acd5fe00ba2196f67a046fe769bd63f4ced04ca20622 WatchSource:0}: Error finding container 99f3c9ee3cc4dda9e786acd5fe00ba2196f67a046fe769bd63f4ced04ca20622: Status 404 returned error can't find the container with id 99f3c9ee3cc4dda9e786acd5fe00ba2196f67a046fe769bd63f4ced04ca20622 Jul 28 16:22:19.524319 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:19.524287 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zhqrp" event={"ID":"d143b044-60a2-465f-84e7-9d57a496ca40","Type":"ContainerStarted","Data":"99f3c9ee3cc4dda9e786acd5fe00ba2196f67a046fe769bd63f4ced04ca20622"} Jul 28 16:22:20.798469 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:20.798431 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:20.899297 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:20.899245 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:21.000365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:21.000331 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:21.534345 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:21.534308 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zhqrp" event={"ID":"d143b044-60a2-465f-84e7-9d57a496ca40","Type":"ContainerStarted","Data":"ee9b096bac3fe50b6ebaa2f633db557cde02164cc73f4e350763a543ff0f938b"} Jul 28 16:22:21.534542 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:21.534364 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zhqrp" event={"ID":"d143b044-60a2-465f-84e7-9d57a496ca40","Type":"ContainerStarted","Data":"530cfaaed0bdf7ad70528a806989b0145b21f0a6a20637f028d8ef5eea3f61b2"} Jul 28 16:22:21.534542 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:21.534389 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zhqrp" Jul 28 16:22:21.555524 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:21.555475 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zhqrp" podStartSLOduration=129.179015007 podStartE2EDuration="2m10.555459111s" totalImagesPullingTime="1.376444104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:22:21.554378789 +0000 UTC m=+165.216688060" watchObservedRunningTime="2026-07-28 16:22:21.555459111 +0000 UTC m=+165.217768367" Jul 28 16:22:22.201474 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:22.201425 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:22.270992 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:22.270952 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:22.478536 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:22.478444 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:22.546503 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:22.546477 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:23.761646 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:23.761610 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:23.826649 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:23.826609 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:25.164216 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:25.164179 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:25.236370 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:25.236330 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:25.664313 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:25.664279 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:25.664504 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:25.664361 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:25.669483 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:25.669462 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:26.557929 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:26.557895 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:22:26.615754 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:26.615720 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7848b7c496-gkwl6"] Jul 28 16:22:27.779395 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:27.779358 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:27.854449 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:27.854415 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:28.768282 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:28.768238 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:29.286874 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:29.286845 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:22:29.290645 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:29.290616 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cb776bcdf-9pgfh" Jul 28 16:22:31.539947 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:31.539917 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zhqrp" Jul 28 16:22:32.579861 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:32.579836 2549 generic.go:356] "Generic (PLEG): container finished" podID="664cd821-5b25-4de0-be52-c62643b02f1a" containerID="7b8df4a866b4e32fd3892a26c8c45bf2bb6bbfb3c20ed97f865ff65153aebb6d" exitCode=0 Jul 28 16:22:32.580170 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:32.579889 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" event={"ID":"664cd821-5b25-4de0-be52-c62643b02f1a","Type":"ContainerDied","Data":"7b8df4a866b4e32fd3892a26c8c45bf2bb6bbfb3c20ed97f865ff65153aebb6d"} Jul 28 16:22:32.580170 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:32.580162 2549 scope.go:117] "RemoveContainer" containerID="7b8df4a866b4e32fd3892a26c8c45bf2bb6bbfb3c20ed97f865ff65153aebb6d" Jul 28 16:22:33.586288 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:33.586249 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd" event={"ID":"664cd821-5b25-4de0-be52-c62643b02f1a","Type":"ContainerStarted","Data":"8d784e785bfc86a639e7b7d2c32fb2c34b5050bac704575e08d79a529f29ce9d"} Jul 28 16:22:35.084193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:35.084155 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:35.908171 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:35.908136 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:36.008814 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:36.008770 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:40.722515 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:40.722476 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:40.842664 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:40.842631 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:50.911584 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:50.911546 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:50.996081 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:50.996043 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:22:51.638267 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:51.638225 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7848b7c496-gkwl6" podUID="562d5d9f-90f0-4187-ba00-ecd20bf2e717" containerName="console" containerID="cri-o://a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed" gracePeriod=15 Jul 28 16:22:51.880107 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:51.880076 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:52.052704 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.052665 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4qp2\" (UniqueName: \"kubernetes.io/projected/562d5d9f-90f0-4187-ba00-ecd20bf2e717-kube-api-access-k4qp2\") pod \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " Jul 28 16:22:52.052704 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.052717 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-config\") pod \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " Jul 28 16:22:52.053230 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.052792 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-service-ca\") pod \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " Jul 28 16:22:52.053230 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.052814 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-serving-cert\") pod \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " Jul 28 16:22:52.053230 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.052837 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-oauth-config\") pod \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " Jul 28 16:22:52.053230 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.052973 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-oauth-serving-cert\") pod \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\" (UID: \"562d5d9f-90f0-4187-ba00-ecd20bf2e717\") " Jul 28 16:22:52.053434 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.053271 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-config" (OuterVolumeSpecName: "console-config") pod "562d5d9f-90f0-4187-ba00-ecd20bf2e717" (UID: "562d5d9f-90f0-4187-ba00-ecd20bf2e717"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:22:52.053434 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.053280 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-service-ca" (OuterVolumeSpecName: "service-ca") pod "562d5d9f-90f0-4187-ba00-ecd20bf2e717" (UID: "562d5d9f-90f0-4187-ba00-ecd20bf2e717"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:22:52.053434 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.053402 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "562d5d9f-90f0-4187-ba00-ecd20bf2e717" (UID: "562d5d9f-90f0-4187-ba00-ecd20bf2e717"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:22:52.054897 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.054870 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "562d5d9f-90f0-4187-ba00-ecd20bf2e717" (UID: "562d5d9f-90f0-4187-ba00-ecd20bf2e717"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:22:52.055010 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.054932 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "562d5d9f-90f0-4187-ba00-ecd20bf2e717" (UID: "562d5d9f-90f0-4187-ba00-ecd20bf2e717"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:22:52.055010 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.054933 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/562d5d9f-90f0-4187-ba00-ecd20bf2e717-kube-api-access-k4qp2" (OuterVolumeSpecName: "kube-api-access-k4qp2") pod "562d5d9f-90f0-4187-ba00-ecd20bf2e717" (UID: "562d5d9f-90f0-4187-ba00-ecd20bf2e717"). InnerVolumeSpecName "kube-api-access-k4qp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:22:52.154217 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.154197 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-config\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:52.154217 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.154216 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-service-ca\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:52.154332 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.154225 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-serving-cert\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:52.154332 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.154235 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/562d5d9f-90f0-4187-ba00-ecd20bf2e717-console-oauth-config\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:52.154332 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.154244 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/562d5d9f-90f0-4187-ba00-ecd20bf2e717-oauth-serving-cert\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:52.154332 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.154253 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4qp2\" (UniqueName: \"kubernetes.io/projected/562d5d9f-90f0-4187-ba00-ecd20bf2e717-kube-api-access-k4qp2\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:22:52.661593 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.661558 2549 generic.go:356] "Generic (PLEG): container finished" podID="562d5d9f-90f0-4187-ba00-ecd20bf2e717" containerID="a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed" exitCode=0 Jul 28 16:22:52.661757 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.661602 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7848b7c496-gkwl6" Jul 28 16:22:52.661757 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.661643 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7848b7c496-gkwl6" event={"ID":"562d5d9f-90f0-4187-ba00-ecd20bf2e717","Type":"ContainerDied","Data":"a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed"} Jul 28 16:22:52.661757 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.661696 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7848b7c496-gkwl6" event={"ID":"562d5d9f-90f0-4187-ba00-ecd20bf2e717","Type":"ContainerDied","Data":"aa1c2a2e6c8d8daf94d27b53237726298675838436f60b635791191e97c023c8"} Jul 28 16:22:52.661757 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.661722 2549 scope.go:117] "RemoveContainer" containerID="a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed" Jul 28 16:22:52.670032 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.670010 2549 scope.go:117] "RemoveContainer" containerID="a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed" Jul 28 16:22:52.670281 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:22:52.670262 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed\": container with ID starting with a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed not found: ID does not exist" containerID="a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed" Jul 28 16:22:52.670355 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.670290 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed"} err="failed to get container status \"a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed\": rpc error: code = NotFound desc = could not find container \"a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed\": container with ID starting with a7cf61a87e8850eb733afe6cc66fa7efd60e1015ab618a7195a15447cd0cafed not found: ID does not exist" Jul 28 16:22:52.683033 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.683013 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7848b7c496-gkwl6"] Jul 28 16:22:52.688219 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.688200 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7848b7c496-gkwl6"] Jul 28 16:22:52.783295 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:22:52.783272 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="562d5d9f-90f0-4187-ba00-ecd20bf2e717" path="/var/lib/kubelet/pods/562d5d9f-90f0-4187-ba00-ecd20bf2e717/volumes" Jul 28 16:23:00.688987 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:00.688952 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:00.790608 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:00.790577 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:01.382315 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.382281 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78d494c9c7-76kpm"] Jul 28 16:23:01.382654 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.382635 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="562d5d9f-90f0-4187-ba00-ecd20bf2e717" containerName="console" Jul 28 16:23:01.382733 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.382655 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="562d5d9f-90f0-4187-ba00-ecd20bf2e717" containerName="console" Jul 28 16:23:01.382822 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.382762 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="562d5d9f-90f0-4187-ba00-ecd20bf2e717" containerName="console" Jul 28 16:23:01.386991 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.386970 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.398945 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.398916 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d494c9c7-76kpm"] Jul 28 16:23:01.459051 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.459017 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:01.522149 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.522116 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-serving-cert\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.522272 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.522154 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-trusted-ca-bundle\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.522272 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.522183 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-oauth-config\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.522272 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.522210 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-service-ca\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.522272 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.522231 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-config\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.522272 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.522250 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lf6c\" (UniqueName: \"kubernetes.io/projected/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-kube-api-access-7lf6c\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.522442 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.522273 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-oauth-serving-cert\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.532830 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.532802 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:01.607899 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.607880 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:01.622613 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.622589 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-serving-cert\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.622711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.622618 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-trusted-ca-bundle\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.622711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.622639 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-oauth-config\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.622711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.622655 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-service-ca\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.622711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.622672 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-config\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.622711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.622690 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lf6c\" (UniqueName: \"kubernetes.io/projected/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-kube-api-access-7lf6c\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.622711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.622706 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-oauth-serving-cert\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.623513 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.623487 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-oauth-serving-cert\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.623603 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.623516 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-service-ca\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.623603 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.623523 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-trusted-ca-bundle\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.623711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.623659 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-config\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.625068 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.625049 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-serving-cert\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.625707 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.625686 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-oauth-config\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.632747 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.632696 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lf6c\" (UniqueName: \"kubernetes.io/projected/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-kube-api-access-7lf6c\") pod \"console-78d494c9c7-76kpm\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.698718 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.698691 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:01.832998 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:01.832974 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d494c9c7-76kpm"] Jul 28 16:23:01.835529 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:23:01.835505 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecec6d38_0da2_4901_98e6_57a8c38fb2c0.slice/crio-e5fc64309bf69e953e29812e95c90c9e9c12d16ab1a8d8aa7468faabf075ab91 WatchSource:0}: Error finding container e5fc64309bf69e953e29812e95c90c9e9c12d16ab1a8d8aa7468faabf075ab91: Status 404 returned error can't find the container with id e5fc64309bf69e953e29812e95c90c9e9c12d16ab1a8d8aa7468faabf075ab91 Jul 28 16:23:02.189130 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:02.189039 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:02.264679 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:02.264649 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:02.704611 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:02.704570 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d494c9c7-76kpm" event={"ID":"ecec6d38-0da2-4901-98e6-57a8c38fb2c0","Type":"ContainerStarted","Data":"721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e"} Jul 28 16:23:02.705054 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:02.704627 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d494c9c7-76kpm" event={"ID":"ecec6d38-0da2-4901-98e6-57a8c38fb2c0","Type":"ContainerStarted","Data":"e5fc64309bf69e953e29812e95c90c9e9c12d16ab1a8d8aa7468faabf075ab91"} Jul 28 16:23:02.724032 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:02.723983 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78d494c9c7-76kpm" podStartSLOduration=1.723966396 podStartE2EDuration="1.723966396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:23:02.722841549 +0000 UTC m=+206.385150806" watchObservedRunningTime="2026-07-28 16:23:02.723966396 +0000 UTC m=+206.386275723" Jul 28 16:23:05.017582 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.017549 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 16:23:05.018039 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.017856 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="alertmanager" containerID="cri-o://83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697" gracePeriod=120 Jul 28 16:23:05.018039 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.017902 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy-metric" containerID="cri-o://2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43" gracePeriod=120 Jul 28 16:23:05.018039 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.017929 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy-web" containerID="cri-o://bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab" gracePeriod=120 Jul 28 16:23:05.018039 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.017983 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy" containerID="cri-o://8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0" gracePeriod=120 Jul 28 16:23:05.018039 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.018008 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="prom-label-proxy" containerID="cri-o://fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8" gracePeriod=120 Jul 28 16:23:05.018268 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.017950 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="config-reloader" containerID="cri-o://5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c" gracePeriod=120 Jul 28 16:23:05.721761 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.721715 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerID="fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8" exitCode=0 Jul 28 16:23:05.721761 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.721743 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerID="8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0" exitCode=0 Jul 28 16:23:05.721761 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.721762 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerID="5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c" exitCode=0 Jul 28 16:23:05.721761 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.721769 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerID="83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697" exitCode=0 Jul 28 16:23:05.722033 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.721801 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerDied","Data":"fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8"} Jul 28 16:23:05.722033 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.721915 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerDied","Data":"8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0"} Jul 28 16:23:05.722033 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.721949 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerDied","Data":"5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c"} Jul 28 16:23:05.722033 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:05.722008 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerDied","Data":"83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697"} Jul 28 16:23:06.253086 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.253062 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.257097 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257079 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257149 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257114 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257149 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257140 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-cluster-tls-config\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257211 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257173 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-metrics-client-ca\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257211 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257192 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-tls-assets\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257310 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257223 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-web\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257310 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257269 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-volume\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257310 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257294 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-trusted-ca-bundle\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257453 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257321 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-out\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257453 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257353 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-web-config\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257453 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257384 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-main-tls\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257453 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257435 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk8qh\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-kube-api-access-gk8qh\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257650 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257492 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-main-db\") pod \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\" (UID: \"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e\") " Jul 28 16:23:06.257650 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257577 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:23:06.257860 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257835 2549 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-metrics-client-ca\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.257950 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.257873 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:23:06.260709 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.260449 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:23:06.260709 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.260461 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-out" (OuterVolumeSpecName: "config-out") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:23:06.260709 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.260473 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-kube-api-access-gk8qh" (OuterVolumeSpecName: "kube-api-access-gk8qh") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "kube-api-access-gk8qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:23:06.260709 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.260484 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:23:06.260990 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.260745 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:23:06.260990 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.260824 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:23:06.260990 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.260911 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:23:06.260990 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.260928 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:23:06.262662 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.262638 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-volume" (OuterVolumeSpecName: "config-volume") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:23:06.264090 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.263992 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:23:06.272525 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.272506 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-web-config" (OuterVolumeSpecName: "web-config") pod "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" (UID: "2b7ee4eb-9d4c-4232-ad51-bd2a286f248e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:23:06.358207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358138 2549 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-volume\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358162 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358171 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-config-out\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358200 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-web-config\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358208 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-main-tls\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358443 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358217 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk8qh\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-kube-api-access-gk8qh\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358443 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358226 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-alertmanager-main-db\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358443 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358234 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358443 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358243 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358443 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358253 2549 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-cluster-tls-config\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358443 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358260 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-tls-assets\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.358443 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.358271 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:06.728671 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.728642 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerID="2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43" exitCode=0 Jul 28 16:23:06.728671 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.728668 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerID="bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab" exitCode=0 Jul 28 16:23:06.728917 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.728724 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.728917 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.728723 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerDied","Data":"2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43"} Jul 28 16:23:06.728917 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.728833 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerDied","Data":"bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab"} Jul 28 16:23:06.728917 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.728879 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b7ee4eb-9d4c-4232-ad51-bd2a286f248e","Type":"ContainerDied","Data":"bed2de6c3f8dda2d409f9f48e2f46904894ca36101eb61cf3b3afc2aea59d168"} Jul 28 16:23:06.728917 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.728895 2549 scope.go:117] "RemoveContainer" containerID="fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8" Jul 28 16:23:06.736700 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.736666 2549 scope.go:117] "RemoveContainer" containerID="2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43" Jul 28 16:23:06.743487 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.743470 2549 scope.go:117] "RemoveContainer" containerID="8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0" Jul 28 16:23:06.750039 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.750021 2549 scope.go:117] "RemoveContainer" containerID="bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab" Jul 28 16:23:06.755542 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.755515 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 16:23:06.756917 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.756903 2549 scope.go:117] "RemoveContainer" containerID="5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c" Jul 28 16:23:06.763525 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.763506 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 16:23:06.764329 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.764310 2549 scope.go:117] "RemoveContainer" containerID="83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697" Jul 28 16:23:06.772678 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.772661 2549 scope.go:117] "RemoveContainer" containerID="4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d" Jul 28 16:23:06.779991 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.779973 2549 scope.go:117] "RemoveContainer" containerID="fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8" Jul 28 16:23:06.780310 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:23:06.780286 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8\": container with ID starting with fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8 not found: ID does not exist" containerID="fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8" Jul 28 16:23:06.780397 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.780315 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8"} err="failed to get container status \"fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8\": rpc error: code = NotFound desc = could not find container \"fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8\": container with ID starting with fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8 not found: ID does not exist" Jul 28 16:23:06.780397 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.780333 2549 scope.go:117] "RemoveContainer" containerID="2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43" Jul 28 16:23:06.780610 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:23:06.780589 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43\": container with ID starting with 2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43 not found: ID does not exist" containerID="2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43" Jul 28 16:23:06.780668 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.780618 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43"} err="failed to get container status \"2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43\": rpc error: code = NotFound desc = could not find container \"2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43\": container with ID starting with 2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43 not found: ID does not exist" Jul 28 16:23:06.780668 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.780634 2549 scope.go:117] "RemoveContainer" containerID="8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0" Jul 28 16:23:06.780924 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:23:06.780903 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0\": container with ID starting with 8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0 not found: ID does not exist" containerID="8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0" Jul 28 16:23:06.781011 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.780932 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0"} err="failed to get container status \"8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0\": rpc error: code = NotFound desc = could not find container \"8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0\": container with ID starting with 8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0 not found: ID does not exist" Jul 28 16:23:06.781011 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.780955 2549 scope.go:117] "RemoveContainer" containerID="bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab" Jul 28 16:23:06.781216 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:23:06.781197 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab\": container with ID starting with bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab not found: ID does not exist" containerID="bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab" Jul 28 16:23:06.781280 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.781224 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab"} err="failed to get container status \"bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab\": rpc error: code = NotFound desc = could not find container \"bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab\": container with ID starting with bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab not found: ID does not exist" Jul 28 16:23:06.781280 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.781245 2549 scope.go:117] "RemoveContainer" containerID="5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c" Jul 28 16:23:06.781535 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:23:06.781505 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c\": container with ID starting with 5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c not found: ID does not exist" containerID="5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c" Jul 28 16:23:06.781612 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.781543 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c"} err="failed to get container status \"5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c\": rpc error: code = NotFound desc = could not find container \"5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c\": container with ID starting with 5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c not found: ID does not exist" Jul 28 16:23:06.781612 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.781564 2549 scope.go:117] "RemoveContainer" containerID="83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697" Jul 28 16:23:06.781875 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:23:06.781851 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697\": container with ID starting with 83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697 not found: ID does not exist" containerID="83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697" Jul 28 16:23:06.781989 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.781879 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697"} err="failed to get container status \"83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697\": rpc error: code = NotFound desc = could not find container \"83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697\": container with ID starting with 83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697 not found: ID does not exist" Jul 28 16:23:06.781989 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.781900 2549 scope.go:117] "RemoveContainer" containerID="4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d" Jul 28 16:23:06.782140 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:23:06.782121 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d\": container with ID starting with 4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d not found: ID does not exist" containerID="4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d" Jul 28 16:23:06.782185 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.782147 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d"} err="failed to get container status \"4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d\": rpc error: code = NotFound desc = could not find container \"4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d\": container with ID starting with 4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d not found: ID does not exist" Jul 28 16:23:06.782185 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.782168 2549 scope.go:117] "RemoveContainer" containerID="fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8" Jul 28 16:23:06.782466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.782441 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8"} err="failed to get container status \"fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8\": rpc error: code = NotFound desc = could not find container \"fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8\": container with ID starting with fd3a30835b70675f61745c0ad85fabeddf73e3e724d58931ac55f0562683e8f8 not found: ID does not exist" Jul 28 16:23:06.782466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.782467 2549 scope.go:117] "RemoveContainer" containerID="2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43" Jul 28 16:23:06.782683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.782664 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43"} err="failed to get container status \"2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43\": rpc error: code = NotFound desc = could not find container \"2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43\": container with ID starting with 2c2435a0c4a7377361c5ff671aaaa1ae127fd6c3cf3eaa227990b14077f7cf43 not found: ID does not exist" Jul 28 16:23:06.782683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.782684 2549 scope.go:117] "RemoveContainer" containerID="8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0" Jul 28 16:23:06.782998 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.782971 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0"} err="failed to get container status \"8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0\": rpc error: code = NotFound desc = could not find container \"8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0\": container with ID starting with 8054953d03d67ec3937d081f24c71993b2d944334e77d44c38c036afe55e70a0 not found: ID does not exist" Jul 28 16:23:06.782998 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.782998 2549 scope.go:117] "RemoveContainer" containerID="bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab" Jul 28 16:23:06.783310 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.783283 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab"} err="failed to get container status \"bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab\": rpc error: code = NotFound desc = could not find container \"bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab\": container with ID starting with bf4ecdeffb1462fcee0313ba86d48d26c12b741bdd628256b5057237494dc9ab not found: ID does not exist" Jul 28 16:23:06.783310 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.783310 2549 scope.go:117] "RemoveContainer" containerID="5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c" Jul 28 16:23:06.783537 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.783516 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c"} err="failed to get container status \"5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c\": rpc error: code = NotFound desc = could not find container \"5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c\": container with ID starting with 5d51ca9f985b6a6bd53b5c481e0efc7f1f087c59a8162534fb1bb417f723418c not found: ID does not exist" Jul 28 16:23:06.783604 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.783537 2549 scope.go:117] "RemoveContainer" containerID="83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697" Jul 28 16:23:06.783846 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.783820 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697"} err="failed to get container status \"83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697\": rpc error: code = NotFound desc = could not find container \"83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697\": container with ID starting with 83c498b67f3a97ea63fd0e180cc0d81b98e4212b09dfd3cbdc7be61681f9a697 not found: ID does not exist" Jul 28 16:23:06.783927 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.783849 2549 scope.go:117] "RemoveContainer" containerID="4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d" Jul 28 16:23:06.784107 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.784090 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d"} err="failed to get container status \"4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d\": rpc error: code = NotFound desc = could not find container \"4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d\": container with ID starting with 4d60a1255e46af272be7f24a57bd0408802028d9b4a742042332cf414f08ac1d not found: ID does not exist" Jul 28 16:23:06.784294 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.784277 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" path="/var/lib/kubelet/pods/2b7ee4eb-9d4c-4232-ad51-bd2a286f248e/volumes" Jul 28 16:23:06.806540 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806522 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 16:23:06.806844 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806829 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="alertmanager" Jul 28 16:23:06.806925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806846 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="alertmanager" Jul 28 16:23:06.806925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806864 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="prom-label-proxy" Jul 28 16:23:06.806925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806874 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="prom-label-proxy" Jul 28 16:23:06.806925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806886 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="init-config-reloader" Jul 28 16:23:06.806925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806894 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="init-config-reloader" Jul 28 16:23:06.806925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806904 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy" Jul 28 16:23:06.806925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806912 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy" Jul 28 16:23:06.806925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806925 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="config-reloader" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806933 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="config-reloader" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806942 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy-metric" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806950 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy-metric" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806965 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy-web" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.806975 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy-web" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.807059 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="prom-label-proxy" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.807072 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="alertmanager" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.807080 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy-metric" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.807090 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="config-reloader" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.807098 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy-web" Jul 28 16:23:06.807308 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.807108 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7ee4eb-9d4c-4232-ad51-bd2a286f248e" containerName="kube-rbac-proxy" Jul 28 16:23:06.812504 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.812487 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.814965 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.814942 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 16:23:06.814965 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.814962 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h8xk7\"" Jul 28 16:23:06.815142 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.814980 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 16:23:06.815142 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.815005 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 16:23:06.815142 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.815035 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 16:23:06.815142 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.814944 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 16:23:06.815472 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.815456 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 16:23:06.815577 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.815501 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 16:23:06.815577 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.815517 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 16:23:06.820878 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.820862 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 16:23:06.827812 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.827765 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 16:23:06.862338 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862312 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-web-config\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862433 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862345 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862433 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862369 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-config-volume\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862433 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862392 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862433 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862428 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862564 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862451 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862564 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862469 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862564 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862490 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862696 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862548 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862696 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862616 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862696 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862664 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz562\" (UniqueName: \"kubernetes.io/projected/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-kube-api-access-qz562\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862696 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862687 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.862855 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.862708 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-config-out\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.963766 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.963738 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.963902 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.963774 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz562\" (UniqueName: \"kubernetes.io/projected/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-kube-api-access-qz562\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.963902 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.963828 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.963902 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.963851 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-config-out\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964044 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.963993 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-web-config\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964044 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.964032 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964136 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.964067 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-config-volume\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964136 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.964084 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964136 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.964109 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964287 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.964150 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964287 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.964178 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964287 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.964202 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964287 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.964235 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.964481 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.964417 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.965407 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.965342 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.966610 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.966561 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.966956 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.966931 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.967045 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.966979 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.967045 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.966998 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-web-config\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.967237 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.967218 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-config-out\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.967334 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.967316 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.967458 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.967437 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-config-volume\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.967642 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.967625 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.968012 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.967994 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.968525 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.968506 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:06.972703 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:06.972685 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz562\" (UniqueName: \"kubernetes.io/projected/17ea6c54-f619-4fbf-8bf4-c0f158e429a2-kube-api-access-qz562\") pod \"alertmanager-main-0\" (UID: \"17ea6c54-f619-4fbf-8bf4-c0f158e429a2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:07.122456 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:07.122435 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 16:23:07.267861 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:07.267830 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 16:23:07.270923 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:23:07.270896 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ea6c54_f619_4fbf_8bf4_c0f158e429a2.slice/crio-cf8a04b5394e9d5b1e7142bc637035cd77078a24fedcdcc888ffd8b5ea1dccbc WatchSource:0}: Error finding container cf8a04b5394e9d5b1e7142bc637035cd77078a24fedcdcc888ffd8b5ea1dccbc: Status 404 returned error can't find the container with id cf8a04b5394e9d5b1e7142bc637035cd77078a24fedcdcc888ffd8b5ea1dccbc Jul 28 16:23:07.735210 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:07.735180 2549 generic.go:356] "Generic (PLEG): container finished" podID="17ea6c54-f619-4fbf-8bf4-c0f158e429a2" containerID="0ede7721c0a9e9b3850dcc6b5804c425f05ad5c7a91eeab3f9ddd5b247528b8b" exitCode=0 Jul 28 16:23:07.735372 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:07.735247 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17ea6c54-f619-4fbf-8bf4-c0f158e429a2","Type":"ContainerDied","Data":"0ede7721c0a9e9b3850dcc6b5804c425f05ad5c7a91eeab3f9ddd5b247528b8b"} Jul 28 16:23:07.735372 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:07.735297 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17ea6c54-f619-4fbf-8bf4-c0f158e429a2","Type":"ContainerStarted","Data":"cf8a04b5394e9d5b1e7142bc637035cd77078a24fedcdcc888ffd8b5ea1dccbc"} Jul 28 16:23:08.743288 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:08.743254 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17ea6c54-f619-4fbf-8bf4-c0f158e429a2","Type":"ContainerStarted","Data":"62253762e47d71dec765b53768f947f658f16244d9baed22a47d63e6907daa00"} Jul 28 16:23:08.743644 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:08.743317 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17ea6c54-f619-4fbf-8bf4-c0f158e429a2","Type":"ContainerStarted","Data":"47e160574bebfc6090861fbda4493f954c324283e468a2f3416737c5810f3c77"} Jul 28 16:23:08.743644 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:08.743348 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17ea6c54-f619-4fbf-8bf4-c0f158e429a2","Type":"ContainerStarted","Data":"05901725f4709d5b16c3e2451bdb8579fa0c732cdc3cb24a99ea5371115209c4"} Jul 28 16:23:08.743644 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:08.743373 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17ea6c54-f619-4fbf-8bf4-c0f158e429a2","Type":"ContainerStarted","Data":"b1b9e5e58e7978f2343fcfb6943b9d4cbf383ebc2a795b1517982b6268f0a645"} Jul 28 16:23:08.743644 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:08.743401 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17ea6c54-f619-4fbf-8bf4-c0f158e429a2","Type":"ContainerStarted","Data":"7f16cb5695269011dc38c86d2e2479413e04eb501f7a922c819b2d5c8d61fdb6"} Jul 28 16:23:08.743644 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:08.743427 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17ea6c54-f619-4fbf-8bf4-c0f158e429a2","Type":"ContainerStarted","Data":"cecf7770301d1db4bf5bdc6fae062d6e3c05f4c744efb0e139e8059d67e25825"} Jul 28 16:23:08.772480 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:08.772431 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.755814852 podStartE2EDuration="2.772414965s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.600113ms" isStatefulPod=false podCreationTimestamp="2026-07-28 16:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:23:08.771185064 +0000 UTC m=+212.433494349" watchObservedRunningTime="2026-07-28 16:23:08.772414965 +0000 UTC m=+212.434724223" Jul 28 16:23:11.698946 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:11.698902 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:11.699309 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:11.698971 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:11.704105 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:11.704084 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:11.758997 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:11.758975 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:23:11.813686 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:11.813656 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d8f6c984-mwpp9"] Jul 28 16:23:11.946015 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:11.945976 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:12.045021 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:12.044944 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:12.124771 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:12.124741 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:12.641929 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:12.641889 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:12.719242 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:12.719204 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:20.940911 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:20.940877 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:21.039186 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:21.039155 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:23:36.833136 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:36.833083 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74d8f6c984-mwpp9" podUID="c37f0602-52ec-49df-bd87-2ac792b70113" containerName="console" containerID="cri-o://54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1" gracePeriod=15 Jul 28 16:23:37.074658 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.074636 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:23:37.204632 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.204556 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm9ps\" (UniqueName: \"kubernetes.io/projected/c37f0602-52ec-49df-bd87-2ac792b70113-kube-api-access-fm9ps\") pod \"c37f0602-52ec-49df-bd87-2ac792b70113\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " Jul 28 16:23:37.204632 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.204614 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-console-config\") pod \"c37f0602-52ec-49df-bd87-2ac792b70113\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " Jul 28 16:23:37.204831 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.204633 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-oauth-serving-cert\") pod \"c37f0602-52ec-49df-bd87-2ac792b70113\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " Jul 28 16:23:37.204831 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.204680 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-service-ca\") pod \"c37f0602-52ec-49df-bd87-2ac792b70113\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " Jul 28 16:23:37.204831 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.204698 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-serving-cert\") pod \"c37f0602-52ec-49df-bd87-2ac792b70113\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " Jul 28 16:23:37.204831 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.204808 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-oauth-config\") pod \"c37f0602-52ec-49df-bd87-2ac792b70113\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " Jul 28 16:23:37.205050 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.204897 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-trusted-ca-bundle\") pod \"c37f0602-52ec-49df-bd87-2ac792b70113\" (UID: \"c37f0602-52ec-49df-bd87-2ac792b70113\") " Jul 28 16:23:37.205106 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.205082 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-console-config" (OuterVolumeSpecName: "console-config") pod "c37f0602-52ec-49df-bd87-2ac792b70113" (UID: "c37f0602-52ec-49df-bd87-2ac792b70113"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:23:37.205106 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.205091 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c37f0602-52ec-49df-bd87-2ac792b70113" (UID: "c37f0602-52ec-49df-bd87-2ac792b70113"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:23:37.205207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.205098 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-service-ca" (OuterVolumeSpecName: "service-ca") pod "c37f0602-52ec-49df-bd87-2ac792b70113" (UID: "c37f0602-52ec-49df-bd87-2ac792b70113"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:23:37.205207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.205167 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-console-config\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:37.205207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.205186 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-oauth-serving-cert\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:37.205207 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.205201 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-service-ca\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:37.205450 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.205424 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c37f0602-52ec-49df-bd87-2ac792b70113" (UID: "c37f0602-52ec-49df-bd87-2ac792b70113"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:23:37.206728 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.206707 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c37f0602-52ec-49df-bd87-2ac792b70113-kube-api-access-fm9ps" (OuterVolumeSpecName: "kube-api-access-fm9ps") pod "c37f0602-52ec-49df-bd87-2ac792b70113" (UID: "c37f0602-52ec-49df-bd87-2ac792b70113"). InnerVolumeSpecName "kube-api-access-fm9ps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:23:37.206830 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.206733 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c37f0602-52ec-49df-bd87-2ac792b70113" (UID: "c37f0602-52ec-49df-bd87-2ac792b70113"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:23:37.206830 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.206814 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c37f0602-52ec-49df-bd87-2ac792b70113" (UID: "c37f0602-52ec-49df-bd87-2ac792b70113"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:23:37.305514 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.305491 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c37f0602-52ec-49df-bd87-2ac792b70113-trusted-ca-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:37.305514 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.305512 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm9ps\" (UniqueName: \"kubernetes.io/projected/c37f0602-52ec-49df-bd87-2ac792b70113-kube-api-access-fm9ps\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:37.305678 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.305521 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-serving-cert\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:37.305678 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.305529 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c37f0602-52ec-49df-bd87-2ac792b70113-console-oauth-config\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:23:37.860674 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.860640 2549 generic.go:356] "Generic (PLEG): container finished" podID="c37f0602-52ec-49df-bd87-2ac792b70113" containerID="54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1" exitCode=0 Jul 28 16:23:37.861092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.860683 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d8f6c984-mwpp9" Jul 28 16:23:37.861092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.860727 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d8f6c984-mwpp9" event={"ID":"c37f0602-52ec-49df-bd87-2ac792b70113","Type":"ContainerDied","Data":"54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1"} Jul 28 16:23:37.861092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.860791 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d8f6c984-mwpp9" event={"ID":"c37f0602-52ec-49df-bd87-2ac792b70113","Type":"ContainerDied","Data":"e427bf20cbd482cf89ef4e4d15c22c12dabefc8ecd45922545a14e17242a5f56"} Jul 28 16:23:37.861092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.860814 2549 scope.go:117] "RemoveContainer" containerID="54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1" Jul 28 16:23:37.870253 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.870236 2549 scope.go:117] "RemoveContainer" containerID="54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1" Jul 28 16:23:37.870517 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:23:37.870493 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1\": container with ID starting with 54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1 not found: ID does not exist" containerID="54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1" Jul 28 16:23:37.870583 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.870518 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1"} err="failed to get container status \"54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1\": rpc error: code = NotFound desc = could not find container \"54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1\": container with ID starting with 54f2d89d9e9251f1a19d1c0cfcc911b6b8d1bd27bec2b03ac107afa62666d0e1 not found: ID does not exist" Jul 28 16:23:37.885193 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.885164 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d8f6c984-mwpp9"] Jul 28 16:23:37.890371 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:37.890350 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74d8f6c984-mwpp9"] Jul 28 16:23:38.783754 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:23:38.783716 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c37f0602-52ec-49df-bd87-2ac792b70113" path="/var/lib/kubelet/pods/c37f0602-52ec-49df-bd87-2ac792b70113/volumes" Jul 28 16:24:04.081341 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:04.081260 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:04.182002 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:04.181967 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:04.396679 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:04.396606 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:04.531418 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:04.531379 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:04.632847 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:04.632821 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:05.430383 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.430353 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l"] Jul 28 16:24:05.430758 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.430691 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c37f0602-52ec-49df-bd87-2ac792b70113" containerName="console" Jul 28 16:24:05.430758 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.430702 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c37f0602-52ec-49df-bd87-2ac792b70113" containerName="console" Jul 28 16:24:05.430882 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.430759 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c37f0602-52ec-49df-bd87-2ac792b70113" containerName="console" Jul 28 16:24:05.433770 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.433745 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.436083 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.436059 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 16:24:05.437047 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.437026 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fqwzr\"" Jul 28 16:24:05.437160 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.437045 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 16:24:05.442819 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.442795 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l"] Jul 28 16:24:05.608285 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.608254 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.608407 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.608289 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.608407 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.608357 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrzn8\" (UniqueName: \"kubernetes.io/projected/b5443bbe-8d9e-4cf5-af62-0418f837d81f-kube-api-access-xrzn8\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.709648 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.709627 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.709726 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.709661 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.709726 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.709711 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrzn8\" (UniqueName: \"kubernetes.io/projected/b5443bbe-8d9e-4cf5-af62-0418f837d81f-kube-api-access-xrzn8\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.710073 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.710055 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.710115 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.710059 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.719357 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.719330 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrzn8\" (UniqueName: \"kubernetes.io/projected/b5443bbe-8d9e-4cf5-af62-0418f837d81f-kube-api-access-xrzn8\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.743950 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.743927 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:05.869637 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.869613 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l"] Jul 28 16:24:05.872103 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:24:05.872079 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5443bbe_8d9e_4cf5_af62_0418f837d81f.slice/crio-9b856489ef7cf2fe6d121950fd9e151c77bb99c9efbd7d0c18ea9157212b34ef WatchSource:0}: Error finding container 9b856489ef7cf2fe6d121950fd9e151c77bb99c9efbd7d0c18ea9157212b34ef: Status 404 returned error can't find the container with id 9b856489ef7cf2fe6d121950fd9e151c77bb99c9efbd7d0c18ea9157212b34ef Jul 28 16:24:05.976736 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:05.976674 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" event={"ID":"b5443bbe-8d9e-4cf5-af62-0418f837d81f","Type":"ContainerStarted","Data":"9b856489ef7cf2fe6d121950fd9e151c77bb99c9efbd7d0c18ea9157212b34ef"} Jul 28 16:24:12.003822 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:12.003772 2549 generic.go:356] "Generic (PLEG): container finished" podID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerID="2e9cffdc437b2bcad79f0df2439e204c2d19d6f3a8905b27d978994ff9e75e94" exitCode=0 Jul 28 16:24:12.004263 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:12.003888 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" event={"ID":"b5443bbe-8d9e-4cf5-af62-0418f837d81f","Type":"ContainerDied","Data":"2e9cffdc437b2bcad79f0df2439e204c2d19d6f3a8905b27d978994ff9e75e94"} Jul 28 16:24:15.021325 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:15.021294 2549 generic.go:356] "Generic (PLEG): container finished" podID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerID="8af9394e53ec3e9a75f18a662c6843dda596e582bba9cf130477e3fee0ff8a9f" exitCode=0 Jul 28 16:24:15.021688 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:15.021387 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" event={"ID":"b5443bbe-8d9e-4cf5-af62-0418f837d81f","Type":"ContainerDied","Data":"8af9394e53ec3e9a75f18a662c6843dda596e582bba9cf130477e3fee0ff8a9f"} Jul 28 16:24:22.053383 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:22.053345 2549 generic.go:356] "Generic (PLEG): container finished" podID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerID="3679e2082aa273bea9f463ff240789b63ad333819348e67e9d77b24f4f532d3a" exitCode=0 Jul 28 16:24:22.053740 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:22.053411 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" event={"ID":"b5443bbe-8d9e-4cf5-af62-0418f837d81f","Type":"ContainerDied","Data":"3679e2082aa273bea9f463ff240789b63ad333819348e67e9d77b24f4f532d3a"} Jul 28 16:24:23.177844 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.177822 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:23.249399 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.249377 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrzn8\" (UniqueName: \"kubernetes.io/projected/b5443bbe-8d9e-4cf5-af62-0418f837d81f-kube-api-access-xrzn8\") pod \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " Jul 28 16:24:23.249532 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.249423 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-bundle\") pod \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " Jul 28 16:24:23.249532 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.249465 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-util\") pod \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\" (UID: \"b5443bbe-8d9e-4cf5-af62-0418f837d81f\") " Jul 28 16:24:23.250109 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.250087 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-bundle" (OuterVolumeSpecName: "bundle") pod "b5443bbe-8d9e-4cf5-af62-0418f837d81f" (UID: "b5443bbe-8d9e-4cf5-af62-0418f837d81f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:24:23.251512 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.251480 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5443bbe-8d9e-4cf5-af62-0418f837d81f-kube-api-access-xrzn8" (OuterVolumeSpecName: "kube-api-access-xrzn8") pod "b5443bbe-8d9e-4cf5-af62-0418f837d81f" (UID: "b5443bbe-8d9e-4cf5-af62-0418f837d81f"). InnerVolumeSpecName "kube-api-access-xrzn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:24:23.254478 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.254456 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-util" (OuterVolumeSpecName: "util") pod "b5443bbe-8d9e-4cf5-af62-0418f837d81f" (UID: "b5443bbe-8d9e-4cf5-af62-0418f837d81f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:24:23.350591 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.350537 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:24:23.350591 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.350558 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5443bbe-8d9e-4cf5-af62-0418f837d81f-util\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:24:23.350591 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:23.350566 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrzn8\" (UniqueName: \"kubernetes.io/projected/b5443bbe-8d9e-4cf5-af62-0418f837d81f-kube-api-access-xrzn8\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:24:24.062550 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:24.062518 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" Jul 28 16:24:24.062711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:24.062521 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54qx2l" event={"ID":"b5443bbe-8d9e-4cf5-af62-0418f837d81f","Type":"ContainerDied","Data":"9b856489ef7cf2fe6d121950fd9e151c77bb99c9efbd7d0c18ea9157212b34ef"} Jul 28 16:24:24.062711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:24.062634 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b856489ef7cf2fe6d121950fd9e151c77bb99c9efbd7d0c18ea9157212b34ef" Jul 28 16:24:26.617564 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:26.617520 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:26.711126 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:26.711099 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:27.832670 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.832632 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm"] Jul 28 16:24:27.833091 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.832977 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerName="pull" Jul 28 16:24:27.833091 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.832990 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerName="pull" Jul 28 16:24:27.833091 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.833001 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerName="extract" Jul 28 16:24:27.833091 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.833006 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerName="extract" Jul 28 16:24:27.833091 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.833024 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerName="util" Jul 28 16:24:27.833091 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.833030 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerName="util" Jul 28 16:24:27.833091 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.833081 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5443bbe-8d9e-4cf5-af62-0418f837d81f" containerName="extract" Jul 28 16:24:27.836584 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.836566 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:24:27.839824 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.839799 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 28 16:24:27.839970 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.839823 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 28 16:24:27.839970 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.839799 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-48c76\"" Jul 28 16:24:27.840188 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.840174 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 28 16:24:27.852383 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.852360 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm"] Jul 28 16:24:27.882661 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.882634 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3289de07-6583-40df-86c8-0e2b5608682f-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm\" (UID: \"3289de07-6583-40df-86c8-0e2b5608682f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:24:27.882809 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.882661 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjflw\" (UniqueName: \"kubernetes.io/projected/3289de07-6583-40df-86c8-0e2b5608682f-kube-api-access-xjflw\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm\" (UID: \"3289de07-6583-40df-86c8-0e2b5608682f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:24:27.983594 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.983572 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3289de07-6583-40df-86c8-0e2b5608682f-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm\" (UID: \"3289de07-6583-40df-86c8-0e2b5608682f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:24:27.983677 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.983598 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjflw\" (UniqueName: \"kubernetes.io/projected/3289de07-6583-40df-86c8-0e2b5608682f-kube-api-access-xjflw\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm\" (UID: \"3289de07-6583-40df-86c8-0e2b5608682f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:24:27.985731 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.985708 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3289de07-6583-40df-86c8-0e2b5608682f-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm\" (UID: \"3289de07-6583-40df-86c8-0e2b5608682f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:24:27.998110 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:27.998092 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjflw\" (UniqueName: \"kubernetes.io/projected/3289de07-6583-40df-86c8-0e2b5608682f-kube-api-access-xjflw\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm\" (UID: \"3289de07-6583-40df-86c8-0e2b5608682f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:24:28.146657 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:28.146597 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:24:28.274552 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:28.274522 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm"] Jul 28 16:24:28.278578 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:24:28.278549 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3289de07_6583_40df_86c8_0e2b5608682f.slice/crio-6f6f304234cab42ebf82ce036a08074638fea491f97671f7bd69f8073ba2ac0e WatchSource:0}: Error finding container 6f6f304234cab42ebf82ce036a08074638fea491f97671f7bd69f8073ba2ac0e: Status 404 returned error can't find the container with id 6f6f304234cab42ebf82ce036a08074638fea491f97671f7bd69f8073ba2ac0e Jul 28 16:24:29.083695 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:29.083660 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" event={"ID":"3289de07-6583-40df-86c8-0e2b5608682f","Type":"ContainerStarted","Data":"6f6f304234cab42ebf82ce036a08074638fea491f97671f7bd69f8073ba2ac0e"} Jul 28 16:24:31.095236 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:31.095202 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" event={"ID":"3289de07-6583-40df-86c8-0e2b5608682f","Type":"ContainerStarted","Data":"5aef0d7a15df1e7b9427ff5a1d681e1ccc0c90641de75c7df88738c5d13f431a"} Jul 28 16:24:31.095598 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:31.095330 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:24:31.116001 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:31.115825 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" podStartSLOduration=1.5407141069999999 podStartE2EDuration="4.115809466s" totalImagesPullingTime="2.575095359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:24:31.114839459 +0000 UTC m=+294.777148715" watchObservedRunningTime="2026-07-28 16:24:31.115809466 +0000 UTC m=+294.778118724" Jul 28 16:24:31.296609 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:31.296575 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:31.652969 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:31.652935 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:31.816897 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:31.816861 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:32.015713 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.015680 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:32.061067 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.061037 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx"] Jul 28 16:24:32.063471 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.063456 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.065398 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.065376 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 28 16:24:32.065502 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.065413 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 28 16:24:32.065502 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.065413 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-nnlx7\"" Jul 28 16:24:32.073126 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.073105 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx"] Jul 28 16:24:32.113768 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.113739 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/67503c09-175a-4934-a389-6d3ad451140b-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.114053 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.113858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9rcc\" (UniqueName: \"kubernetes.io/projected/67503c09-175a-4934-a389-6d3ad451140b-kube-api-access-b9rcc\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.114053 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.113884 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/67503c09-175a-4934-a389-6d3ad451140b-certificates\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.214787 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.214758 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9rcc\" (UniqueName: \"kubernetes.io/projected/67503c09-175a-4934-a389-6d3ad451140b-kube-api-access-b9rcc\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.214889 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.214819 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/67503c09-175a-4934-a389-6d3ad451140b-certificates\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.214889 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.214882 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/67503c09-175a-4934-a389-6d3ad451140b-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.215014 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:24:32.214995 2549 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Jul 28 16:24:32.215052 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:24:32.215032 2549 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx: secret "keda-metrics-apiserver-certs" not found Jul 28 16:24:32.215102 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:24:32.215093 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67503c09-175a-4934-a389-6d3ad451140b-certificates podName:67503c09-175a-4934-a389-6d3ad451140b nodeName:}" failed. No retries permitted until 2026-07-28 16:24:32.715070184 +0000 UTC m=+296.377379425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/67503c09-175a-4934-a389-6d3ad451140b-certificates") pod "keda-metrics-apiserver-55557df8c-kvqmx" (UID: "67503c09-175a-4934-a389-6d3ad451140b") : secret "keda-metrics-apiserver-certs" not found Jul 28 16:24:32.215258 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.215243 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/67503c09-175a-4934-a389-6d3ad451140b-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.228093 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.228068 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9rcc\" (UniqueName: \"kubernetes.io/projected/67503c09-175a-4934-a389-6d3ad451140b-kube-api-access-b9rcc\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.305070 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.304994 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:32.431099 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.431068 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:32.586311 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.586227 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:32.719531 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.719495 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/67503c09-175a-4934-a389-6d3ad451140b-certificates\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.722012 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.721991 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/67503c09-175a-4934-a389-6d3ad451140b-certificates\") pod \"keda-metrics-apiserver-55557df8c-kvqmx\" (UID: \"67503c09-175a-4934-a389-6d3ad451140b\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:32.787587 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.787558 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:32.973594 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:32.973559 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:33.100419 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:33.100381 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:33.106960 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:33.106924 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx"] Jul 28 16:24:33.109695 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:24:33.109671 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67503c09_175a_4934_a389_6d3ad451140b.slice/crio-23f65de9f58590f04ec7028087a9aaad7083ab9bea0bee6586c4f1c000ac0089 WatchSource:0}: Error finding container 23f65de9f58590f04ec7028087a9aaad7083ab9bea0bee6586c4f1c000ac0089: Status 404 returned error can't find the container with id 23f65de9f58590f04ec7028087a9aaad7083ab9bea0bee6586c4f1c000ac0089 Jul 28 16:24:33.196877 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:33.196837 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:34.109398 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:34.109359 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" event={"ID":"67503c09-175a-4934-a389-6d3ad451140b","Type":"ContainerStarted","Data":"23f65de9f58590f04ec7028087a9aaad7083ab9bea0bee6586c4f1c000ac0089"} Jul 28 16:24:36.119773 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:36.119683 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" event={"ID":"67503c09-175a-4934-a389-6d3ad451140b","Type":"ContainerStarted","Data":"f6c7c46266521aed0adc81c3358558548e76be758cbb590428dea8ef36c2be8b"} Jul 28 16:24:36.120143 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:36.119795 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:36.136822 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:36.136757 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" podStartSLOduration=1.49278693 podStartE2EDuration="4.136738233s" totalImagesPullingTime="2.643951303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:24:36.136134727 +0000 UTC m=+299.798443982" watchObservedRunningTime="2026-07-28 16:24:36.136738233 +0000 UTC m=+299.799047489" Jul 28 16:24:36.700329 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:36.700304 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:24:36.700495 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:36.700354 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:24:36.711690 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:36.711676 2549 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 16:24:44.746528 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:44.746498 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:24:47.128248 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:47.128216 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-kvqmx" Jul 28 16:24:52.102139 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:24:52.102111 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-q6fxm" Jul 28 16:25:24.918374 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:24.918332 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:31.099605 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:31.099524 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:31.200591 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:31.200559 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:38.012985 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:38.012950 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:38.091749 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:38.091722 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:49.841362 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.841306 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:49.905466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.905430 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-q6zhg"] Jul 28 16:25:49.908787 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.908760 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:25:49.910688 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.910660 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 28 16:25:49.910865 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.910844 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 16:25:49.910928 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.910914 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 16:25:49.911278 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.911264 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-jwj9b\"" Jul 28 16:25:49.919197 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.919177 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-q6zhg"] Jul 28 16:25:49.927407 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.927388 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84d9876847-wwzdb"] Jul 28 16:25:49.930791 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.930759 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:25:49.932889 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.932864 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 28 16:25:49.932996 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.932918 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-fskt5\"" Jul 28 16:25:49.940720 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.940702 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84d9876847-wwzdb"] Jul 28 16:25:49.976636 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.976607 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:49.991345 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.991321 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc87c3f0-9293-4f04-b6ac-cb10db4fd785-cert\") pod \"llmisvc-controller-manager-84d9876847-wwzdb\" (UID: \"bc87c3f0-9293-4f04-b6ac-cb10db4fd785\") " pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:25:49.991425 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.991377 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8kll\" (UniqueName: \"kubernetes.io/projected/0818c265-0a0a-40d2-857f-bb7dc97edb61-kube-api-access-v8kll\") pod \"kserve-controller-manager-85d8b8ddfc-q6zhg\" (UID: \"0818c265-0a0a-40d2-857f-bb7dc97edb61\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:25:49.991468 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.991440 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0818c265-0a0a-40d2-857f-bb7dc97edb61-cert\") pod \"kserve-controller-manager-85d8b8ddfc-q6zhg\" (UID: \"0818c265-0a0a-40d2-857f-bb7dc97edb61\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:25:49.991468 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:49.991463 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkzs8\" (UniqueName: \"kubernetes.io/projected/bc87c3f0-9293-4f04-b6ac-cb10db4fd785-kube-api-access-bkzs8\") pod \"llmisvc-controller-manager-84d9876847-wwzdb\" (UID: \"bc87c3f0-9293-4f04-b6ac-cb10db4fd785\") " pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:25:50.092567 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.092481 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8kll\" (UniqueName: \"kubernetes.io/projected/0818c265-0a0a-40d2-857f-bb7dc97edb61-kube-api-access-v8kll\") pod \"kserve-controller-manager-85d8b8ddfc-q6zhg\" (UID: \"0818c265-0a0a-40d2-857f-bb7dc97edb61\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:25:50.092567 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.092551 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0818c265-0a0a-40d2-857f-bb7dc97edb61-cert\") pod \"kserve-controller-manager-85d8b8ddfc-q6zhg\" (UID: \"0818c265-0a0a-40d2-857f-bb7dc97edb61\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:25:50.092567 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.092571 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkzs8\" (UniqueName: \"kubernetes.io/projected/bc87c3f0-9293-4f04-b6ac-cb10db4fd785-kube-api-access-bkzs8\") pod \"llmisvc-controller-manager-84d9876847-wwzdb\" (UID: \"bc87c3f0-9293-4f04-b6ac-cb10db4fd785\") " pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:25:50.092863 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.092606 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc87c3f0-9293-4f04-b6ac-cb10db4fd785-cert\") pod \"llmisvc-controller-manager-84d9876847-wwzdb\" (UID: \"bc87c3f0-9293-4f04-b6ac-cb10db4fd785\") " pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:25:50.095239 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.095212 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc87c3f0-9293-4f04-b6ac-cb10db4fd785-cert\") pod \"llmisvc-controller-manager-84d9876847-wwzdb\" (UID: \"bc87c3f0-9293-4f04-b6ac-cb10db4fd785\") " pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:25:50.095363 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.095249 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0818c265-0a0a-40d2-857f-bb7dc97edb61-cert\") pod \"kserve-controller-manager-85d8b8ddfc-q6zhg\" (UID: \"0818c265-0a0a-40d2-857f-bb7dc97edb61\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:25:50.095363 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.095302 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:50.101595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.101574 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8kll\" (UniqueName: \"kubernetes.io/projected/0818c265-0a0a-40d2-857f-bb7dc97edb61-kube-api-access-v8kll\") pod \"kserve-controller-manager-85d8b8ddfc-q6zhg\" (UID: \"0818c265-0a0a-40d2-857f-bb7dc97edb61\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:25:50.101827 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.101802 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkzs8\" (UniqueName: \"kubernetes.io/projected/bc87c3f0-9293-4f04-b6ac-cb10db4fd785-kube-api-access-bkzs8\") pod \"llmisvc-controller-manager-84d9876847-wwzdb\" (UID: \"bc87c3f0-9293-4f04-b6ac-cb10db4fd785\") " pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:25:50.193489 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.193436 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:50.219843 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.219822 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:25:50.240805 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.240750 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:25:50.364709 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.364521 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-q6zhg"] Jul 28 16:25:50.367414 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:25:50.367390 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0818c265_0a0a_40d2_857f_bb7dc97edb61.slice/crio-878bfe9dc33afff9dff758b42007174696aa867ebd0523a87db7cb6e0e555596 WatchSource:0}: Error finding container 878bfe9dc33afff9dff758b42007174696aa867ebd0523a87db7cb6e0e555596: Status 404 returned error can't find the container with id 878bfe9dc33afff9dff758b42007174696aa867ebd0523a87db7cb6e0e555596 Jul 28 16:25:50.368693 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.368677 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:25:50.387765 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.387740 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84d9876847-wwzdb"] Jul 28 16:25:50.391132 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:25:50.391110 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc87c3f0_9293_4f04_b6ac_cb10db4fd785.slice/crio-96b0a6db2e60a17f74742586cfe64b37148d1b451dd37cd08fe41c5d96dd35e5 WatchSource:0}: Error finding container 96b0a6db2e60a17f74742586cfe64b37148d1b451dd37cd08fe41c5d96dd35e5: Status 404 returned error can't find the container with id 96b0a6db2e60a17f74742586cfe64b37148d1b451dd37cd08fe41c5d96dd35e5 Jul 28 16:25:50.435796 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.435744 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" event={"ID":"0818c265-0a0a-40d2-857f-bb7dc97edb61","Type":"ContainerStarted","Data":"878bfe9dc33afff9dff758b42007174696aa867ebd0523a87db7cb6e0e555596"} Jul 28 16:25:50.436837 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.436810 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" event={"ID":"bc87c3f0-9293-4f04-b6ac-cb10db4fd785","Type":"ContainerStarted","Data":"96b0a6db2e60a17f74742586cfe64b37148d1b451dd37cd08fe41c5d96dd35e5"} Jul 28 16:25:50.935361 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:50.935266 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:51.035853 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:51.035710 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:51.123635 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:51.123534 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:25:53.454074 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:53.454037 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" event={"ID":"0818c265-0a0a-40d2-857f-bb7dc97edb61","Type":"ContainerStarted","Data":"838516d541d223d46c87af0e09e7e29542f265c9a676f1b42de02355fbb0a9f1"} Jul 28 16:25:53.454499 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:53.454157 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:25:53.471713 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:53.471657 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" podStartSLOduration=1.74759229 podStartE2EDuration="4.471637859s" totalImagesPullingTime="2.724045569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:25:53.471032053 +0000 UTC m=+377.133341376" watchObservedRunningTime="2026-07-28 16:25:53.471637859 +0000 UTC m=+377.133947117" Jul 28 16:25:54.459989 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:54.459942 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" event={"ID":"bc87c3f0-9293-4f04-b6ac-cb10db4fd785","Type":"ContainerStarted","Data":"d61c2005919ac86b8ea59c2dd20fa0cad9e307bff5bd2c11e94a9ef9f2d56565"} Jul 28 16:25:54.460371 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:54.460137 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:25:54.477203 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:25:54.477156 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" podStartSLOduration=2.093560975 podStartE2EDuration="5.47714263s" totalImagesPullingTime="3.383581655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:25:54.475704926 +0000 UTC m=+378.138014184" watchObservedRunningTime="2026-07-28 16:25:54.47714263 +0000 UTC m=+378.139451904" Jul 28 16:26:24.464851 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:24.464821 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-85d8b8ddfc-q6zhg" Jul 28 16:26:25.465760 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:25.465733 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84d9876847-wwzdb" Jul 28 16:26:33.115073 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.115036 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:33.254434 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.254400 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:33.395175 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.395098 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj"] Jul 28 16:26:33.397651 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.397634 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.400539 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.400518 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fqwzr\"" Jul 28 16:26:33.400630 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.400556 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 16:26:33.401143 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.401112 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 16:26:33.414103 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.414080 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj"] Jul 28 16:26:33.563063 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.563030 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7m84\" (UniqueName: \"kubernetes.io/projected/39442305-296b-4eb3-a327-28b73e6db829-kube-api-access-f7m84\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.563225 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.563080 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.563225 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.563107 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.664522 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.664450 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7m84\" (UniqueName: \"kubernetes.io/projected/39442305-296b-4eb3-a327-28b73e6db829-kube-api-access-f7m84\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.664522 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.664499 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.664685 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.664525 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.664899 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.664884 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.664942 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.664930 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.673658 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.673634 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7m84\" (UniqueName: \"kubernetes.io/projected/39442305-296b-4eb3-a327-28b73e6db829-kube-api-access-f7m84\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.706509 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.706489 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:33.834560 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:33.834526 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj"] Jul 28 16:26:33.838271 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:26:33.838241 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39442305_296b_4eb3_a327_28b73e6db829.slice/crio-13a40f54c37ec2f02a62b7b4adc72baac9bb5c4bb810b8fae3fca77e30892ba5 WatchSource:0}: Error finding container 13a40f54c37ec2f02a62b7b4adc72baac9bb5c4bb810b8fae3fca77e30892ba5: Status 404 returned error can't find the container with id 13a40f54c37ec2f02a62b7b4adc72baac9bb5c4bb810b8fae3fca77e30892ba5 Jul 28 16:26:34.633868 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:34.633836 2549 generic.go:356] "Generic (PLEG): container finished" podID="39442305-296b-4eb3-a327-28b73e6db829" containerID="60dafceb8acb77ef1de3fad98040ec6861fa87c501bbd2075af601935cbea062" exitCode=0 Jul 28 16:26:34.634237 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:34.633933 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" event={"ID":"39442305-296b-4eb3-a327-28b73e6db829","Type":"ContainerDied","Data":"60dafceb8acb77ef1de3fad98040ec6861fa87c501bbd2075af601935cbea062"} Jul 28 16:26:34.634237 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:34.633988 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" event={"ID":"39442305-296b-4eb3-a327-28b73e6db829","Type":"ContainerStarted","Data":"13a40f54c37ec2f02a62b7b4adc72baac9bb5c4bb810b8fae3fca77e30892ba5"} Jul 28 16:26:37.650927 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:37.650891 2549 generic.go:356] "Generic (PLEG): container finished" podID="39442305-296b-4eb3-a327-28b73e6db829" containerID="4d1cc95b27d9856b5070233c700d4d19b110b02d79b836d8c5a17de22eb4ed16" exitCode=0 Jul 28 16:26:37.651330 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:37.650947 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" event={"ID":"39442305-296b-4eb3-a327-28b73e6db829","Type":"ContainerDied","Data":"4d1cc95b27d9856b5070233c700d4d19b110b02d79b836d8c5a17de22eb4ed16"} Jul 28 16:26:37.892167 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:37.892132 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:38.657052 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:38.657017 2549 generic.go:356] "Generic (PLEG): container finished" podID="39442305-296b-4eb3-a327-28b73e6db829" containerID="6a44394b6c3e6cbde705aa004b3374eece167b5766bb55206b5fac5ee8cac6e2" exitCode=0 Jul 28 16:26:38.657419 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:38.657083 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" event={"ID":"39442305-296b-4eb3-a327-28b73e6db829","Type":"ContainerDied","Data":"6a44394b6c3e6cbde705aa004b3374eece167b5766bb55206b5fac5ee8cac6e2"} Jul 28 16:26:39.783592 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.783568 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:39.815062 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.815041 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-util\") pod \"39442305-296b-4eb3-a327-28b73e6db829\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " Jul 28 16:26:39.815160 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.815096 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-bundle\") pod \"39442305-296b-4eb3-a327-28b73e6db829\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " Jul 28 16:26:39.815160 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.815144 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7m84\" (UniqueName: \"kubernetes.io/projected/39442305-296b-4eb3-a327-28b73e6db829-kube-api-access-f7m84\") pod \"39442305-296b-4eb3-a327-28b73e6db829\" (UID: \"39442305-296b-4eb3-a327-28b73e6db829\") " Jul 28 16:26:39.815948 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.815924 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-bundle" (OuterVolumeSpecName: "bundle") pod "39442305-296b-4eb3-a327-28b73e6db829" (UID: "39442305-296b-4eb3-a327-28b73e6db829"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:26:39.817736 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.817704 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39442305-296b-4eb3-a327-28b73e6db829-kube-api-access-f7m84" (OuterVolumeSpecName: "kube-api-access-f7m84") pod "39442305-296b-4eb3-a327-28b73e6db829" (UID: "39442305-296b-4eb3-a327-28b73e6db829"). InnerVolumeSpecName "kube-api-access-f7m84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:26:39.819879 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.819857 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-util" (OuterVolumeSpecName: "util") pod "39442305-296b-4eb3-a327-28b73e6db829" (UID: "39442305-296b-4eb3-a327-28b73e6db829"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:26:39.916421 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.916348 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7m84\" (UniqueName: \"kubernetes.io/projected/39442305-296b-4eb3-a327-28b73e6db829-kube-api-access-f7m84\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:26:39.916421 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.916375 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-util\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:26:39.916421 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:39.916386 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39442305-296b-4eb3-a327-28b73e6db829-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:26:40.668032 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:40.667998 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" event={"ID":"39442305-296b-4eb3-a327-28b73e6db829","Type":"ContainerDied","Data":"13a40f54c37ec2f02a62b7b4adc72baac9bb5c4bb810b8fae3fca77e30892ba5"} Jul 28 16:26:40.668032 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:40.668040 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407nqmj" Jul 28 16:26:40.668288 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:40.668045 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13a40f54c37ec2f02a62b7b4adc72baac9bb5c4bb810b8fae3fca77e30892ba5" Jul 28 16:26:44.397255 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:44.397223 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:45.401130 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:45.401085 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:46.679345 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.679312 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv"] Jul 28 16:26:46.679832 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.679814 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39442305-296b-4eb3-a327-28b73e6db829" containerName="extract" Jul 28 16:26:46.679923 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.679836 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="39442305-296b-4eb3-a327-28b73e6db829" containerName="extract" Jul 28 16:26:46.679923 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.679861 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39442305-296b-4eb3-a327-28b73e6db829" containerName="util" Jul 28 16:26:46.679923 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.679869 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="39442305-296b-4eb3-a327-28b73e6db829" containerName="util" Jul 28 16:26:46.679923 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.679881 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39442305-296b-4eb3-a327-28b73e6db829" containerName="pull" Jul 28 16:26:46.679923 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.679890 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="39442305-296b-4eb3-a327-28b73e6db829" containerName="pull" Jul 28 16:26:46.680215 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.679986 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="39442305-296b-4eb3-a327-28b73e6db829" containerName="extract" Jul 28 16:26:46.683755 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.683735 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" Jul 28 16:26:46.685744 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.685709 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:26:46.685877 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.685743 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 28 16:26:46.685877 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.685743 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-b4mhq\"" Jul 28 16:26:46.703999 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.703974 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv"] Jul 28 16:26:46.764658 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.764622 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63148707-b214-4e8e-ac63-c55d5df9c1c5-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-gf9tv\" (UID: \"63148707-b214-4e8e-ac63-c55d5df9c1c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" Jul 28 16:26:46.764812 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.764671 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbj6z\" (UniqueName: \"kubernetes.io/projected/63148707-b214-4e8e-ac63-c55d5df9c1c5-kube-api-access-dbj6z\") pod \"cert-manager-operator-controller-manager-684f79c9b9-gf9tv\" (UID: \"63148707-b214-4e8e-ac63-c55d5df9c1c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" Jul 28 16:26:46.865203 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.865176 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63148707-b214-4e8e-ac63-c55d5df9c1c5-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-gf9tv\" (UID: \"63148707-b214-4e8e-ac63-c55d5df9c1c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" Jul 28 16:26:46.865293 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.865218 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj6z\" (UniqueName: \"kubernetes.io/projected/63148707-b214-4e8e-ac63-c55d5df9c1c5-kube-api-access-dbj6z\") pod \"cert-manager-operator-controller-manager-684f79c9b9-gf9tv\" (UID: \"63148707-b214-4e8e-ac63-c55d5df9c1c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" Jul 28 16:26:46.865517 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.865499 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63148707-b214-4e8e-ac63-c55d5df9c1c5-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-gf9tv\" (UID: \"63148707-b214-4e8e-ac63-c55d5df9c1c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" Jul 28 16:26:46.875697 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.875673 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbj6z\" (UniqueName: \"kubernetes.io/projected/63148707-b214-4e8e-ac63-c55d5df9c1c5-kube-api-access-dbj6z\") pod \"cert-manager-operator-controller-manager-684f79c9b9-gf9tv\" (UID: \"63148707-b214-4e8e-ac63-c55d5df9c1c5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" Jul 28 16:26:46.993068 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:46.993046 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" Jul 28 16:26:47.136625 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:47.136595 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv"] Jul 28 16:26:47.141566 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:26:47.141540 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63148707_b214_4e8e_ac63_c55d5df9c1c5.slice/crio-c0401cb423f75e0d1943cd35c1ce71a6279e94b3038ce06a2f45b962e4710e8d WatchSource:0}: Error finding container c0401cb423f75e0d1943cd35c1ce71a6279e94b3038ce06a2f45b962e4710e8d: Status 404 returned error can't find the container with id c0401cb423f75e0d1943cd35c1ce71a6279e94b3038ce06a2f45b962e4710e8d Jul 28 16:26:47.709738 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:47.709693 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" event={"ID":"63148707-b214-4e8e-ac63-c55d5df9c1c5","Type":"ContainerStarted","Data":"c0401cb423f75e0d1943cd35c1ce71a6279e94b3038ce06a2f45b962e4710e8d"} Jul 28 16:26:48.423353 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:48.423313 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:48.556112 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:48.556083 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:50.725959 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:50.725918 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" event={"ID":"63148707-b214-4e8e-ac63-c55d5df9c1c5","Type":"ContainerStarted","Data":"6cb4f42e5ae25906127bcc828d2915653b92d51540057fe58cec45f7193f4a6c"} Jul 28 16:26:50.761839 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:50.761767 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-gf9tv" podStartSLOduration=1.8115769579999998 podStartE2EDuration="4.761748035s" totalImagesPullingTime="2.950171077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:26:50.761096629 +0000 UTC m=+434.423405885" watchObservedRunningTime="2026-07-28 16:26:50.761748035 +0000 UTC m=+434.424057291" Jul 28 16:26:51.180070 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:51.179977 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:51.495383 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:51.495353 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:53.230182 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:53.230145 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:53.406642 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:53.406604 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:53.663925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:53.663843 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:53.862104 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:53.862070 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:54.764117 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:54.764071 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:55.034459 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.034331 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:26:55.569045 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.569012 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt"] Jul 28 16:26:55.572860 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.572837 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.575505 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.575482 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 16:26:55.576103 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.576082 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 16:26:55.576176 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.576091 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fqwzr\"" Jul 28 16:26:55.588186 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.588165 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt"] Jul 28 16:26:55.639427 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.639397 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flj6b\" (UniqueName: \"kubernetes.io/projected/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-kube-api-access-flj6b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.639555 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.639439 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.639555 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.639527 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.740330 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.740299 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flj6b\" (UniqueName: \"kubernetes.io/projected/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-kube-api-access-flj6b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.740436 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.740341 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.740547 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.740527 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.740662 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.740646 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.740851 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.740834 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.751683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.751660 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flj6b\" (UniqueName: \"kubernetes.io/projected/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-kube-api-access-flj6b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:55.881469 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:55.881414 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:26:56.022655 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:56.022628 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt"] Jul 28 16:26:56.024997 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:26:56.024971 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f6ef3a_e800_467a_92b8_0ab83f5ca1ec.slice/crio-e1d8af8f7055b3aeb5052b89027d59e3c9a927a5e5248920c7aba20e7c2612a2 WatchSource:0}: Error finding container e1d8af8f7055b3aeb5052b89027d59e3c9a927a5e5248920c7aba20e7c2612a2: Status 404 returned error can't find the container with id e1d8af8f7055b3aeb5052b89027d59e3c9a927a5e5248920c7aba20e7c2612a2 Jul 28 16:26:56.756299 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:56.756271 2549 generic.go:356] "Generic (PLEG): container finished" podID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerID="8a160af0cdc52791beee0ccc782876784ebad3abfc7a5d037131639063c88c96" exitCode=0 Jul 28 16:26:56.756459 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:56.756367 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" event={"ID":"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec","Type":"ContainerDied","Data":"8a160af0cdc52791beee0ccc782876784ebad3abfc7a5d037131639063c88c96"} Jul 28 16:26:56.756459 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:56.756427 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" event={"ID":"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec","Type":"ContainerStarted","Data":"e1d8af8f7055b3aeb5052b89027d59e3c9a927a5e5248920c7aba20e7c2612a2"} Jul 28 16:26:58.768145 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:58.768109 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" event={"ID":"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec","Type":"ContainerStarted","Data":"23b4fa2e2ebd4caadcd40f2efcaa4f34e0dd1360582eef3ea0ff45fee938d735"} Jul 28 16:26:59.775111 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:59.775026 2549 generic.go:356] "Generic (PLEG): container finished" podID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerID="23b4fa2e2ebd4caadcd40f2efcaa4f34e0dd1360582eef3ea0ff45fee938d735" exitCode=0 Jul 28 16:26:59.775565 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:26:59.775121 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" event={"ID":"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec","Type":"ContainerDied","Data":"23b4fa2e2ebd4caadcd40f2efcaa4f34e0dd1360582eef3ea0ff45fee938d735"} Jul 28 16:27:00.781925 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:00.781891 2549 generic.go:356] "Generic (PLEG): container finished" podID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerID="fa13b2cc27b21334ae8c1ec772823bd447a8318a914b18c77538a1c470ad2b05" exitCode=0 Jul 28 16:27:00.785090 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:00.785068 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" event={"ID":"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec","Type":"ContainerDied","Data":"fa13b2cc27b21334ae8c1ec772823bd447a8318a914b18c77538a1c470ad2b05"} Jul 28 16:27:00.813550 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:00.813517 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:01.039979 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.039904 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:01.260168 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.260136 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:01.771109 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.771075 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rmhsf"] Jul 28 16:27:01.774944 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.774928 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rmhsf" Jul 28 16:27:01.777190 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.777170 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 16:27:01.777294 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.777196 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 16:27:01.777349 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.777332 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9g2j6\"" Jul 28 16:27:01.786225 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.786203 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rmhsf"] Jul 28 16:27:01.888661 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.888618 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpzj5\" (UniqueName: \"kubernetes.io/projected/320fc2d7-1de7-4fa6-b2a5-412d12523b2b-kube-api-access-wpzj5\") pod \"cert-manager-55b4d954d5-rmhsf\" (UID: \"320fc2d7-1de7-4fa6-b2a5-412d12523b2b\") " pod="cert-manager/cert-manager-55b4d954d5-rmhsf" Jul 28 16:27:01.888661 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.888658 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/320fc2d7-1de7-4fa6-b2a5-412d12523b2b-bound-sa-token\") pod \"cert-manager-55b4d954d5-rmhsf\" (UID: \"320fc2d7-1de7-4fa6-b2a5-412d12523b2b\") " pod="cert-manager/cert-manager-55b4d954d5-rmhsf" Jul 28 16:27:01.915090 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.915066 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:27:01.989847 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.989809 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flj6b\" (UniqueName: \"kubernetes.io/projected/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-kube-api-access-flj6b\") pod \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " Jul 28 16:27:01.990004 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.989867 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-bundle\") pod \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " Jul 28 16:27:01.990004 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.989951 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-util\") pod \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\" (UID: \"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec\") " Jul 28 16:27:01.990131 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.990110 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzj5\" (UniqueName: \"kubernetes.io/projected/320fc2d7-1de7-4fa6-b2a5-412d12523b2b-kube-api-access-wpzj5\") pod \"cert-manager-55b4d954d5-rmhsf\" (UID: \"320fc2d7-1de7-4fa6-b2a5-412d12523b2b\") " pod="cert-manager/cert-manager-55b4d954d5-rmhsf" Jul 28 16:27:01.990188 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.990161 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/320fc2d7-1de7-4fa6-b2a5-412d12523b2b-bound-sa-token\") pod \"cert-manager-55b4d954d5-rmhsf\" (UID: \"320fc2d7-1de7-4fa6-b2a5-412d12523b2b\") " pod="cert-manager/cert-manager-55b4d954d5-rmhsf" Jul 28 16:27:01.990363 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.990339 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-bundle" (OuterVolumeSpecName: "bundle") pod "e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" (UID: "e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:01.992600 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.992572 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-kube-api-access-flj6b" (OuterVolumeSpecName: "kube-api-access-flj6b") pod "e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" (UID: "e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec"). InnerVolumeSpecName "kube-api-access-flj6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:27:01.994802 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:01.994763 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-util" (OuterVolumeSpecName: "util") pod "e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" (UID: "e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:02.004745 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.004713 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/320fc2d7-1de7-4fa6-b2a5-412d12523b2b-bound-sa-token\") pod \"cert-manager-55b4d954d5-rmhsf\" (UID: \"320fc2d7-1de7-4fa6-b2a5-412d12523b2b\") " pod="cert-manager/cert-manager-55b4d954d5-rmhsf" Jul 28 16:27:02.004881 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.004792 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpzj5\" (UniqueName: \"kubernetes.io/projected/320fc2d7-1de7-4fa6-b2a5-412d12523b2b-kube-api-access-wpzj5\") pod \"cert-manager-55b4d954d5-rmhsf\" (UID: \"320fc2d7-1de7-4fa6-b2a5-412d12523b2b\") " pod="cert-manager/cert-manager-55b4d954d5-rmhsf" Jul 28 16:27:02.083585 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.083498 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rmhsf" Jul 28 16:27:02.090720 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.090701 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-util\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:02.090720 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.090721 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flj6b\" (UniqueName: \"kubernetes.io/projected/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-kube-api-access-flj6b\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:02.090885 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.090732 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:02.232575 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.232541 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rmhsf"] Jul 28 16:27:02.235461 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:27:02.235430 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod320fc2d7_1de7_4fa6_b2a5_412d12523b2b.slice/crio-77c82c60fbd943cd1d40951da7f1ba0dca2c2135a62ad3fd7e7638b84ec47b3f WatchSource:0}: Error finding container 77c82c60fbd943cd1d40951da7f1ba0dca2c2135a62ad3fd7e7638b84ec47b3f: Status 404 returned error can't find the container with id 77c82c60fbd943cd1d40951da7f1ba0dca2c2135a62ad3fd7e7638b84ec47b3f Jul 28 16:27:02.795316 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.795280 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rmhsf" event={"ID":"320fc2d7-1de7-4fa6-b2a5-412d12523b2b","Type":"ContainerStarted","Data":"77c82c60fbd943cd1d40951da7f1ba0dca2c2135a62ad3fd7e7638b84ec47b3f"} Jul 28 16:27:02.798077 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.797633 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" event={"ID":"e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec","Type":"ContainerDied","Data":"e1d8af8f7055b3aeb5052b89027d59e3c9a927a5e5248920c7aba20e7c2612a2"} Jul 28 16:27:02.798077 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.797677 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1d8af8f7055b3aeb5052b89027d59e3c9a927a5e5248920c7aba20e7c2612a2" Jul 28 16:27:02.798077 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:02.797747 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9rgpt" Jul 28 16:27:05.812912 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:05.812873 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rmhsf" event={"ID":"320fc2d7-1de7-4fa6-b2a5-412d12523b2b","Type":"ContainerStarted","Data":"cad916ded8f86b08742e8c59163e175db209812f35ee69782d22e15f009dc6b5"} Jul 28 16:27:05.840494 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:05.840442 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rmhsf" podStartSLOduration=2.325270404 podStartE2EDuration="4.840426214s" totalImagesPullingTime="2.51515581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:27:05.83873128 +0000 UTC m=+449.501040536" watchObservedRunningTime="2026-07-28 16:27:05.840426214 +0000 UTC m=+449.502735470" Jul 28 16:27:06.712890 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:06.712859 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:06.868798 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:06.868740 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:07.357799 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.357747 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-89bd56646-47mhv"] Jul 28 16:27:07.358114 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.358100 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerName="extract" Jul 28 16:27:07.358159 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.358116 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerName="extract" Jul 28 16:27:07.358159 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.358133 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerName="pull" Jul 28 16:27:07.358159 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.358140 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerName="pull" Jul 28 16:27:07.358159 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.358158 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerName="util" Jul 28 16:27:07.358284 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.358164 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerName="util" Jul 28 16:27:07.358284 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.358218 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f6ef3a-e800-467a-92b8-0ab83f5ca1ec" containerName="extract" Jul 28 16:27:07.361369 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.361346 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.382724 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.382694 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89bd56646-47mhv"] Jul 28 16:27:07.436967 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.436937 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-service-ca\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.437092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.436972 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-console-oauth-config\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.437092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.437000 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-oauth-serving-cert\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.437092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.437054 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-console-config\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.437092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.437078 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-trusted-ca-bundle\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.437230 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.437121 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27rt6\" (UniqueName: \"kubernetes.io/projected/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-kube-api-access-27rt6\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.437230 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.437139 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-console-serving-cert\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.509832 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.509801 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:07.538474 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.538447 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-console-config\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.538605 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.538489 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-trusted-ca-bundle\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.538605 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.538522 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27rt6\" (UniqueName: \"kubernetes.io/projected/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-kube-api-access-27rt6\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.538605 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.538550 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-console-serving-cert\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.538605 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.538588 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-service-ca\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.538858 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.538701 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-console-oauth-config\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.538858 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.538761 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-oauth-serving-cert\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.539355 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.539328 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-console-config\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.539355 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.539344 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-service-ca\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.539571 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.539544 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-oauth-serving-cert\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.539682 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.539667 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-trusted-ca-bundle\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.541063 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.541040 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-console-oauth-config\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.541203 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.541186 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-console-serving-cert\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.547956 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.547936 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27rt6\" (UniqueName: \"kubernetes.io/projected/f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9-kube-api-access-27rt6\") pod \"console-89bd56646-47mhv\" (UID: \"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9\") " pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.671727 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.671671 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:07.678906 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.678885 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:07.825576 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:07.825539 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89bd56646-47mhv"] Jul 28 16:27:07.831717 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:27:07.831691 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2cdc7e5_3aed_46b8_aede_a3e6c4dc98a9.slice/crio-65b4351f96a1afc4fb8eb063e64339b12817cd2e51319a4a1d944e905377211c WatchSource:0}: Error finding container 65b4351f96a1afc4fb8eb063e64339b12817cd2e51319a4a1d944e905377211c: Status 404 returned error can't find the container with id 65b4351f96a1afc4fb8eb063e64339b12817cd2e51319a4a1d944e905377211c Jul 28 16:27:08.831796 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:08.831742 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89bd56646-47mhv" event={"ID":"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9","Type":"ContainerStarted","Data":"19c265c8c76dca0103be136a908de13426e8ab84881d812be5291b9763f9e9fa"} Jul 28 16:27:08.832165 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:08.831814 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89bd56646-47mhv" event={"ID":"f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9","Type":"ContainerStarted","Data":"65b4351f96a1afc4fb8eb063e64339b12817cd2e51319a4a1d944e905377211c"} Jul 28 16:27:08.851585 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:08.851542 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-89bd56646-47mhv" podStartSLOduration=1.851526669 podStartE2EDuration="1.851526669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:27:08.850143686 +0000 UTC m=+452.512452942" watchObservedRunningTime="2026-07-28 16:27:08.851526669 +0000 UTC m=+452.513835925" Jul 28 16:27:17.672290 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:17.672247 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:17.672680 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:17.672546 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:17.677261 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:17.677239 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:17.877155 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:17.877127 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-89bd56646-47mhv" Jul 28 16:27:17.953492 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:17.953457 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d494c9c7-76kpm"] Jul 28 16:27:18.217658 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:18.217569 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:18.466175 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:18.466129 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:23.619715 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:23.619677 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:23.768407 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:23.768379 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:24.879161 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:24.879125 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:28.014527 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:28.014489 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:28.142379 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:28.142345 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:29.806405 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.806375 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7"] Jul 28 16:27:29.812869 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.812845 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.814975 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.814953 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 16:27:29.814975 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.814978 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-swlj9\"" Jul 28 16:27:29.815169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.814990 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 28 16:27:29.815169 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.815064 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 16:27:29.826482 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.826461 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7"] Jul 28 16:27:29.913796 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.913749 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-istio-envoy\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.913961 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.913888 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-credential-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.913961 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.913922 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a7f7089-a078-46ab-a591-799611eedb7c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.914051 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.913977 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-workload-certs\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.914135 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.914115 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-workload-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.914201 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.914185 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-istio-data\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.914259 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.914216 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a7f7089-a078-46ab-a591-799611eedb7c-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.914259 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.914244 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmxkz\" (UniqueName: \"kubernetes.io/projected/7a7f7089-a078-46ab-a591-799611eedb7c-kube-api-access-kmxkz\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.914367 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.914276 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7f7089-a078-46ab-a591-799611eedb7c-istio-token\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:29.929279 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:29.929248 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:30.015152 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015129 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-istio-envoy\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015298 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015192 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-credential-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015298 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015239 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a7f7089-a078-46ab-a591-799611eedb7c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015298 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015289 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-workload-certs\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015514 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015330 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-workload-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015514 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015358 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-istio-data\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015514 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015383 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a7f7089-a078-46ab-a591-799611eedb7c-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015514 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015407 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmxkz\" (UniqueName: \"kubernetes.io/projected/7a7f7089-a078-46ab-a591-799611eedb7c-kube-api-access-kmxkz\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015514 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7f7089-a078-46ab-a591-799611eedb7c-istio-token\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015749 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015571 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-credential-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015749 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015670 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-workload-certs\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015870 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015812 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-workload-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.015996 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015975 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a7f7089-a078-46ab-a591-799611eedb7c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.016042 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.015990 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-istio-data\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.017407 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.017390 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a7f7089-a078-46ab-a591-799611eedb7c-istio-envoy\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.018129 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.018107 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a7f7089-a078-46ab-a591-799611eedb7c-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.025503 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.025480 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmxkz\" (UniqueName: \"kubernetes.io/projected/7a7f7089-a078-46ab-a591-799611eedb7c-kube-api-access-kmxkz\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.025595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.025486 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7f7089-a078-46ab-a591-799611eedb7c-istio-token\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7\" (UID: \"7a7f7089-a078-46ab-a591-799611eedb7c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.028964 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.028943 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:30.125140 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.125090 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:30.259804 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.259762 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7"] Jul 28 16:27:30.263276 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:27:30.263252 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7f7089_a078_46ab_a591_799611eedb7c.slice/crio-35bd183c0e401ba920fa10cb9cf16fc8b891306fd714a79df70925f5fe71dc42 WatchSource:0}: Error finding container 35bd183c0e401ba920fa10cb9cf16fc8b891306fd714a79df70925f5fe71dc42: Status 404 returned error can't find the container with id 35bd183c0e401ba920fa10cb9cf16fc8b891306fd714a79df70925f5fe71dc42 Jul 28 16:27:30.939340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:30.939300 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" event={"ID":"7a7f7089-a078-46ab-a591-799611eedb7c","Type":"ContainerStarted","Data":"35bd183c0e401ba920fa10cb9cf16fc8b891306fd714a79df70925f5fe71dc42"} Jul 28 16:27:32.859955 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:32.859841 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:32.957086 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:32.957050 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 28 16:27:32.957177 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:32.957123 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 28 16:27:32.957177 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:32.957153 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 28 16:27:33.140036 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.139922 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:33.224183 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.224148 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65db47d57-5gt77"] Jul 28 16:27:33.227521 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.227498 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.230289 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.230258 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:27:33.230413 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.230289 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 28 16:27:33.230413 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.230326 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 28 16:27:33.230413 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.230330 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 28 16:27:33.230413 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.230358 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gwsq2\"" Jul 28 16:27:33.230595 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.230268 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 28 16:27:33.238327 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.238309 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65db47d57-5gt77"] Jul 28 16:27:33.264277 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.264245 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:33.346757 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.346729 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbstx\" (UniqueName: \"kubernetes.io/projected/9e317f2a-5be9-46f8-b528-f883c8829ebd-kube-api-access-sbstx\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.346871 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.346811 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e317f2a-5be9-46f8-b528-f883c8829ebd-cert\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.346871 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.346843 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e317f2a-5be9-46f8-b528-f883c8829ebd-manager-config\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.346980 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.346870 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e317f2a-5be9-46f8-b528-f883c8829ebd-metrics-cert\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.447436 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.447414 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbstx\" (UniqueName: \"kubernetes.io/projected/9e317f2a-5be9-46f8-b528-f883c8829ebd-kube-api-access-sbstx\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.447530 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.447450 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e317f2a-5be9-46f8-b528-f883c8829ebd-cert\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.447530 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.447470 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e317f2a-5be9-46f8-b528-f883c8829ebd-manager-config\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.447530 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.447497 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e317f2a-5be9-46f8-b528-f883c8829ebd-metrics-cert\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.448144 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.448115 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e317f2a-5be9-46f8-b528-f883c8829ebd-manager-config\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.449943 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.449925 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e317f2a-5be9-46f8-b528-f883c8829ebd-cert\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.450031 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.449982 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e317f2a-5be9-46f8-b528-f883c8829ebd-metrics-cert\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.464017 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.463989 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbstx\" (UniqueName: \"kubernetes.io/projected/9e317f2a-5be9-46f8-b528-f883c8829ebd-kube-api-access-sbstx\") pod \"lws-controller-manager-65db47d57-5gt77\" (UID: \"9e317f2a-5be9-46f8-b528-f883c8829ebd\") " pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.537519 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.537495 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:33.674011 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.673985 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65db47d57-5gt77"] Jul 28 16:27:33.675951 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:27:33.675925 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e317f2a_5be9_46f8_b528_f883c8829ebd.slice/crio-aa0e19a2ec3958d6a0a31edd8df5cc9e6975beabf9d66891b10dd0f5eb52a34b WatchSource:0}: Error finding container aa0e19a2ec3958d6a0a31edd8df5cc9e6975beabf9d66891b10dd0f5eb52a34b: Status 404 returned error can't find the container with id aa0e19a2ec3958d6a0a31edd8df5cc9e6975beabf9d66891b10dd0f5eb52a34b Jul 28 16:27:33.954099 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.954059 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" event={"ID":"7a7f7089-a078-46ab-a591-799611eedb7c","Type":"ContainerStarted","Data":"495c504a0061f60139607f15f87679b58ebf80d4e31a0922ee8ea201b8acba19"} Jul 28 16:27:33.955278 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.955254 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" event={"ID":"9e317f2a-5be9-46f8-b528-f883c8829ebd","Type":"ContainerStarted","Data":"aa0e19a2ec3958d6a0a31edd8df5cc9e6975beabf9d66891b10dd0f5eb52a34b"} Jul 28 16:27:33.979606 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:33.979562 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" podStartSLOduration=2.288141098 podStartE2EDuration="4.979547304s" totalImagesPullingTime="2.691406206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:27:33.978000232 +0000 UTC m=+477.640309501" watchObservedRunningTime="2026-07-28 16:27:33.979547304 +0000 UTC m=+477.641856560" Jul 28 16:27:34.125445 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:34.125415 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:34.129991 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:34.129969 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:34.960344 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:34.960302 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:34.961434 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:34.961410 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7" Jul 28 16:27:35.390603 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:35.390577 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:35.533075 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:35.532977 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:35.966401 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:35.966368 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" event={"ID":"9e317f2a-5be9-46f8-b528-f883c8829ebd","Type":"ContainerStarted","Data":"5aefb66b7ba02303717fae2997b3566ddeb160e59c55d8c487bdeb7d57d24ef5"} Jul 28 16:27:35.966955 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:35.966567 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:35.987970 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:35.987926 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" podStartSLOduration=1.451819558 podStartE2EDuration="2.987912641s" totalImagesPullingTime="1.536093083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:27:35.985659576 +0000 UTC m=+479.647968833" watchObservedRunningTime="2026-07-28 16:27:35.987912641 +0000 UTC m=+479.650221898" Jul 28 16:27:39.517943 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.517907 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p"] Jul 28 16:27:39.522596 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.522577 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.524714 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.524692 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 16:27:39.525209 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.525189 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fqwzr\"" Jul 28 16:27:39.525209 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.525201 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 16:27:39.533736 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.533705 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p"] Jul 28 16:27:39.600269 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.600241 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rppkk\" (UniqueName: \"kubernetes.io/projected/08a01dc0-0530-4969-b7dc-88b80727bb57-kube-api-access-rppkk\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.600384 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.600307 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.600384 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.600341 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.611487 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.611465 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x"] Jul 28 16:27:39.615467 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.615452 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.624158 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.624135 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x"] Jul 28 16:27:39.700801 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.700761 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.700920 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.700813 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.700920 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.700856 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88dtx\" (UniqueName: \"kubernetes.io/projected/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-kube-api-access-88dtx\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.700920 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.700901 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.701071 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.700966 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rppkk\" (UniqueName: \"kubernetes.io/projected/08a01dc0-0530-4969-b7dc-88b80727bb57-kube-api-access-rppkk\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.701071 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.701030 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.701191 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.701120 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.701257 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.701234 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.716371 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.716346 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rppkk\" (UniqueName: \"kubernetes.io/projected/08a01dc0-0530-4969-b7dc-88b80727bb57-kube-api-access-rppkk\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.724854 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.724832 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft"] Jul 28 16:27:39.729085 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.729069 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.747440 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.747418 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft"] Jul 28 16:27:39.801641 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.801584 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.801641 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.801619 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.801793 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.801701 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.801793 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.801764 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b962\" (UniqueName: \"kubernetes.io/projected/325fff58-1104-4284-a02a-b3b38f8deab0-kube-api-access-8b962\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.801876 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.801816 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.801876 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.801846 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88dtx\" (UniqueName: \"kubernetes.io/projected/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-kube-api-access-88dtx\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.802143 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.802124 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.802183 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.802161 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.810639 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.810612 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn"] Jul 28 16:27:39.819562 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.819531 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88dtx\" (UniqueName: \"kubernetes.io/projected/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-kube-api-access-88dtx\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.821125 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.821106 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:39.825281 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.825263 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn"] Jul 28 16:27:39.832189 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.832170 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:39.903223 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.903192 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:39.903353 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.903306 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b962\" (UniqueName: \"kubernetes.io/projected/325fff58-1104-4284-a02a-b3b38f8deab0-kube-api-access-8b962\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.903393 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.903354 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c76dx\" (UniqueName: \"kubernetes.io/projected/466b6c49-dd2f-45ad-b121-e294fba55465-kube-api-access-c76dx\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:39.903431 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.903391 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.903431 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.903408 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:39.903537 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.903435 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.903809 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.903762 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.903870 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.903853 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.913626 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.913604 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b962\" (UniqueName: \"kubernetes.io/projected/325fff58-1104-4284-a02a-b3b38f8deab0-kube-api-access-8b962\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:39.924079 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.923991 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:39.988307 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:39.988273 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p"] Jul 28 16:27:39.992397 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:27:39.992348 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a01dc0_0530_4969_b7dc_88b80727bb57.slice/crio-fc32314058d36c940e1b037a4d79315944770e0174e124a3c12a18f33190f0c7 WatchSource:0}: Error finding container fc32314058d36c940e1b037a4d79315944770e0174e124a3c12a18f33190f0c7: Status 404 returned error can't find the container with id fc32314058d36c940e1b037a4d79315944770e0174e124a3c12a18f33190f0c7 Jul 28 16:27:40.004235 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.004048 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c76dx\" (UniqueName: \"kubernetes.io/projected/466b6c49-dd2f-45ad-b121-e294fba55465-kube-api-access-c76dx\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:40.004235 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.004110 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:40.004235 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.004184 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:40.004670 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.004642 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:40.004790 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.004691 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:40.014116 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.014090 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76dx\" (UniqueName: \"kubernetes.io/projected/466b6c49-dd2f-45ad-b121-e294fba55465-kube-api-access-c76dx\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:40.038029 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.037979 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:40.080939 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.080915 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x"] Jul 28 16:27:40.083552 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:27:40.083531 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc3b1b0_8ab2_4dcf_9dc7_14232d039937.slice/crio-ce60ed78d60567f4cccdb92966e2e8d6f14c8bf34fa93a4a955e0852b511dbf6 WatchSource:0}: Error finding container ce60ed78d60567f4cccdb92966e2e8d6f14c8bf34fa93a4a955e0852b511dbf6: Status 404 returned error can't find the container with id ce60ed78d60567f4cccdb92966e2e8d6f14c8bf34fa93a4a955e0852b511dbf6 Jul 28 16:27:40.136245 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.136219 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:40.190085 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.189979 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft"] Jul 28 16:27:40.195343 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:27:40.191865 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325fff58_1104_4284_a02a_b3b38f8deab0.slice/crio-b9e66a7e7d2efcf7c1211001aa2da287b34c53ef922e43f6b78960f4033cd6e5 WatchSource:0}: Error finding container b9e66a7e7d2efcf7c1211001aa2da287b34c53ef922e43f6b78960f4033cd6e5: Status 404 returned error can't find the container with id b9e66a7e7d2efcf7c1211001aa2da287b34c53ef922e43f6b78960f4033cd6e5 Jul 28 16:27:40.286939 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.286912 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn"] Jul 28 16:27:40.310830 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:27:40.310799 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466b6c49_dd2f_45ad_b121_e294fba55465.slice/crio-63eee556423aa24cdeaec4766097a02670aca476d02a34fce480bf3d3a324492 WatchSource:0}: Error finding container 63eee556423aa24cdeaec4766097a02670aca476d02a34fce480bf3d3a324492: Status 404 returned error can't find the container with id 63eee556423aa24cdeaec4766097a02670aca476d02a34fce480bf3d3a324492 Jul 28 16:27:40.993386 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.993352 2549 generic.go:356] "Generic (PLEG): container finished" podID="466b6c49-dd2f-45ad-b121-e294fba55465" containerID="52505877eb715077ad2404b0e033da1bf5587cf2063515e5cff2fd24c58368a3" exitCode=0 Jul 28 16:27:40.993853 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.993446 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" event={"ID":"466b6c49-dd2f-45ad-b121-e294fba55465","Type":"ContainerDied","Data":"52505877eb715077ad2404b0e033da1bf5587cf2063515e5cff2fd24c58368a3"} Jul 28 16:27:40.993853 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.993509 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" event={"ID":"466b6c49-dd2f-45ad-b121-e294fba55465","Type":"ContainerStarted","Data":"63eee556423aa24cdeaec4766097a02670aca476d02a34fce480bf3d3a324492"} Jul 28 16:27:40.995127 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.995103 2549 generic.go:356] "Generic (PLEG): container finished" podID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerID="87e43b8ff0e38f7852d72495cd6140bb1a438ef62b1c4e6a5a134b4e13c51afb" exitCode=0 Jul 28 16:27:40.995200 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.995181 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" event={"ID":"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937","Type":"ContainerDied","Data":"87e43b8ff0e38f7852d72495cd6140bb1a438ef62b1c4e6a5a134b4e13c51afb"} Jul 28 16:27:40.995248 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.995222 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" event={"ID":"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937","Type":"ContainerStarted","Data":"ce60ed78d60567f4cccdb92966e2e8d6f14c8bf34fa93a4a955e0852b511dbf6"} Jul 28 16:27:40.997012 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.996983 2549 generic.go:356] "Generic (PLEG): container finished" podID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerID="6adc0f832a907c3ee2ece2f27907085bdc53a0a28549c3a33fd5c377b2d7d349" exitCode=0 Jul 28 16:27:40.997196 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.997148 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" event={"ID":"08a01dc0-0530-4969-b7dc-88b80727bb57","Type":"ContainerDied","Data":"6adc0f832a907c3ee2ece2f27907085bdc53a0a28549c3a33fd5c377b2d7d349"} Jul 28 16:27:40.997196 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.997188 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" event={"ID":"08a01dc0-0530-4969-b7dc-88b80727bb57","Type":"ContainerStarted","Data":"fc32314058d36c940e1b037a4d79315944770e0174e124a3c12a18f33190f0c7"} Jul 28 16:27:40.998917 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.998896 2549 generic.go:356] "Generic (PLEG): container finished" podID="325fff58-1104-4284-a02a-b3b38f8deab0" containerID="6984c6b20ba29191b6f3888ed51b645e10a5966e6581b0faf4e28192cd684b5e" exitCode=0 Jul 28 16:27:40.999001 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.998978 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" event={"ID":"325fff58-1104-4284-a02a-b3b38f8deab0","Type":"ContainerDied","Data":"6984c6b20ba29191b6f3888ed51b645e10a5966e6581b0faf4e28192cd684b5e"} Jul 28 16:27:40.999046 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:40.999030 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" event={"ID":"325fff58-1104-4284-a02a-b3b38f8deab0","Type":"ContainerStarted","Data":"b9e66a7e7d2efcf7c1211001aa2da287b34c53ef922e43f6b78960f4033cd6e5"} Jul 28 16:27:42.011022 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:42.010931 2549 generic.go:356] "Generic (PLEG): container finished" podID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerID="8a16588c246a321e9f9d00564c2a04473c04d6ec66a65225e632260f7d5c12fc" exitCode=0 Jul 28 16:27:42.011355 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:42.011011 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" event={"ID":"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937","Type":"ContainerDied","Data":"8a16588c246a321e9f9d00564c2a04473c04d6ec66a65225e632260f7d5c12fc"} Jul 28 16:27:42.013264 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:42.013238 2549 generic.go:356] "Generic (PLEG): container finished" podID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerID="d5810cf403aa2fbe42292b2a1de4f710a6b8e84e7b371510b7026c1eb7f99e18" exitCode=0 Jul 28 16:27:42.013391 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:42.013325 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" event={"ID":"08a01dc0-0530-4969-b7dc-88b80727bb57","Type":"ContainerDied","Data":"d5810cf403aa2fbe42292b2a1de4f710a6b8e84e7b371510b7026c1eb7f99e18"} Jul 28 16:27:42.015385 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:42.015361 2549 generic.go:356] "Generic (PLEG): container finished" podID="325fff58-1104-4284-a02a-b3b38f8deab0" containerID="8baff9d82cf53298f7af3204a373f012688bfc5d34acd33a83e1be5af2b691a0" exitCode=0 Jul 28 16:27:42.015471 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:42.015440 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" event={"ID":"325fff58-1104-4284-a02a-b3b38f8deab0","Type":"ContainerDied","Data":"8baff9d82cf53298f7af3204a373f012688bfc5d34acd33a83e1be5af2b691a0"} Jul 28 16:27:42.973257 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:42.973217 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78d494c9c7-76kpm" podUID="ecec6d38-0da2-4901-98e6-57a8c38fb2c0" containerName="console" containerID="cri-o://721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e" gracePeriod=15 Jul 28 16:27:43.022389 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.022360 2549 generic.go:356] "Generic (PLEG): container finished" podID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerID="4b6f2779fe6a727d04f6c2d0f4b939f30954a4ba40a8a7c531446a2f14448b86" exitCode=0 Jul 28 16:27:43.022710 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.022447 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" event={"ID":"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937","Type":"ContainerDied","Data":"4b6f2779fe6a727d04f6c2d0f4b939f30954a4ba40a8a7c531446a2f14448b86"} Jul 28 16:27:43.024527 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.024505 2549 generic.go:356] "Generic (PLEG): container finished" podID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerID="79fa3715b33a4da432ec79cab562d8603dcfb34583de3d25fd76bdd44ae07af7" exitCode=0 Jul 28 16:27:43.024645 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.024622 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" event={"ID":"08a01dc0-0530-4969-b7dc-88b80727bb57","Type":"ContainerDied","Data":"79fa3715b33a4da432ec79cab562d8603dcfb34583de3d25fd76bdd44ae07af7"} Jul 28 16:27:43.026622 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.026601 2549 generic.go:356] "Generic (PLEG): container finished" podID="325fff58-1104-4284-a02a-b3b38f8deab0" containerID="32c6eefc222ae00eeaf5ae88b33f315b9a30a587d80ce3912fbaf6f004a2d0e1" exitCode=0 Jul 28 16:27:43.026738 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.026724 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" event={"ID":"325fff58-1104-4284-a02a-b3b38f8deab0","Type":"ContainerDied","Data":"32c6eefc222ae00eeaf5ae88b33f315b9a30a587d80ce3912fbaf6f004a2d0e1"} Jul 28 16:27:43.028456 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.028436 2549 generic.go:356] "Generic (PLEG): container finished" podID="466b6c49-dd2f-45ad-b121-e294fba55465" containerID="0d7e72504057d7fe32a1f8c55b243074f65b70e69f2e274b32040657d62992ec" exitCode=0 Jul 28 16:27:43.028537 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.028467 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" event={"ID":"466b6c49-dd2f-45ad-b121-e294fba55465","Type":"ContainerDied","Data":"0d7e72504057d7fe32a1f8c55b243074f65b70e69f2e274b32040657d62992ec"} Jul 28 16:27:43.277143 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.277121 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:27:43.332812 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.332769 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-trusted-ca-bundle\") pod \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " Jul 28 16:27:43.332915 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.332833 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-serving-cert\") pod \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " Jul 28 16:27:43.332915 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.332863 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-oauth-config\") pod \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " Jul 28 16:27:43.332994 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.332914 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-config\") pod \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " Jul 28 16:27:43.332994 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.332962 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lf6c\" (UniqueName: \"kubernetes.io/projected/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-kube-api-access-7lf6c\") pod \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " Jul 28 16:27:43.333067 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333005 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-oauth-serving-cert\") pod \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " Jul 28 16:27:43.333116 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333086 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-service-ca\") pod \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\" (UID: \"ecec6d38-0da2-4901-98e6-57a8c38fb2c0\") " Jul 28 16:27:43.333202 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333168 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ecec6d38-0da2-4901-98e6-57a8c38fb2c0" (UID: "ecec6d38-0da2-4901-98e6-57a8c38fb2c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:27:43.333423 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333395 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-config" (OuterVolumeSpecName: "console-config") pod "ecec6d38-0da2-4901-98e6-57a8c38fb2c0" (UID: "ecec6d38-0da2-4901-98e6-57a8c38fb2c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:27:43.333560 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333507 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ecec6d38-0da2-4901-98e6-57a8c38fb2c0" (UID: "ecec6d38-0da2-4901-98e6-57a8c38fb2c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:27:43.333560 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333521 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "ecec6d38-0da2-4901-98e6-57a8c38fb2c0" (UID: "ecec6d38-0da2-4901-98e6-57a8c38fb2c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:27:43.333697 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333618 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-oauth-serving-cert\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:43.333697 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333639 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-service-ca\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:43.333697 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333653 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-trusted-ca-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:43.333697 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.333667 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-config\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:43.334954 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.334935 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ecec6d38-0da2-4901-98e6-57a8c38fb2c0" (UID: "ecec6d38-0da2-4901-98e6-57a8c38fb2c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:27:43.335075 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.335056 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ecec6d38-0da2-4901-98e6-57a8c38fb2c0" (UID: "ecec6d38-0da2-4901-98e6-57a8c38fb2c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:27:43.335121 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.335061 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-kube-api-access-7lf6c" (OuterVolumeSpecName: "kube-api-access-7lf6c") pod "ecec6d38-0da2-4901-98e6-57a8c38fb2c0" (UID: "ecec6d38-0da2-4901-98e6-57a8c38fb2c0"). InnerVolumeSpecName "kube-api-access-7lf6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:27:43.434512 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.434488 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-serving-cert\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:43.434512 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.434510 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-console-oauth-config\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:43.434638 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:43.434520 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lf6c\" (UniqueName: \"kubernetes.io/projected/ecec6d38-0da2-4901-98e6-57a8c38fb2c0-kube-api-access-7lf6c\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.034924 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.034895 2549 generic.go:356] "Generic (PLEG): container finished" podID="ecec6d38-0da2-4901-98e6-57a8c38fb2c0" containerID="721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e" exitCode=0 Jul 28 16:27:44.035318 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.034937 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d494c9c7-76kpm" Jul 28 16:27:44.035318 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.034971 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d494c9c7-76kpm" event={"ID":"ecec6d38-0da2-4901-98e6-57a8c38fb2c0","Type":"ContainerDied","Data":"721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e"} Jul 28 16:27:44.035318 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.035023 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d494c9c7-76kpm" event={"ID":"ecec6d38-0da2-4901-98e6-57a8c38fb2c0","Type":"ContainerDied","Data":"e5fc64309bf69e953e29812e95c90c9e9c12d16ab1a8d8aa7468faabf075ab91"} Jul 28 16:27:44.035318 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.035052 2549 scope.go:117] "RemoveContainer" containerID="721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e" Jul 28 16:27:44.037636 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.037603 2549 generic.go:356] "Generic (PLEG): container finished" podID="466b6c49-dd2f-45ad-b121-e294fba55465" containerID="99b115131d5560b927e5c23e443a05c98b1f350f5d19ec528e730d8f00f3ae33" exitCode=0 Jul 28 16:27:44.037743 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.037657 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" event={"ID":"466b6c49-dd2f-45ad-b121-e294fba55465","Type":"ContainerDied","Data":"99b115131d5560b927e5c23e443a05c98b1f350f5d19ec528e730d8f00f3ae33"} Jul 28 16:27:44.050743 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.048968 2549 scope.go:117] "RemoveContainer" containerID="721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e" Jul 28 16:27:44.050743 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:27:44.049424 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e\": container with ID starting with 721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e not found: ID does not exist" containerID="721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e" Jul 28 16:27:44.050743 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.049455 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e"} err="failed to get container status \"721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e\": rpc error: code = NotFound desc = could not find container \"721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e\": container with ID starting with 721dbc718467ac73d5025188fdc399e122f2702be19892f45bd665279de9c56e not found: ID does not exist" Jul 28 16:27:44.076041 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.076008 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d494c9c7-76kpm"] Jul 28 16:27:44.094120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.094090 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78d494c9c7-76kpm"] Jul 28 16:27:44.215384 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.215363 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:44.217411 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.217392 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:44.220321 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.220302 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:44.239967 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.239943 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-util\") pod \"325fff58-1104-4284-a02a-b3b38f8deab0\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " Jul 28 16:27:44.240177 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.240063 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88dtx\" (UniqueName: \"kubernetes.io/projected/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-kube-api-access-88dtx\") pod \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " Jul 28 16:27:44.240282 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.240262 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b962\" (UniqueName: \"kubernetes.io/projected/325fff58-1104-4284-a02a-b3b38f8deab0-kube-api-access-8b962\") pod \"325fff58-1104-4284-a02a-b3b38f8deab0\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " Jul 28 16:27:44.240376 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.240357 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-bundle\") pod \"08a01dc0-0530-4969-b7dc-88b80727bb57\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " Jul 28 16:27:44.240491 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.240409 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-util\") pod \"08a01dc0-0530-4969-b7dc-88b80727bb57\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " Jul 28 16:27:44.240491 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.240438 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rppkk\" (UniqueName: \"kubernetes.io/projected/08a01dc0-0530-4969-b7dc-88b80727bb57-kube-api-access-rppkk\") pod \"08a01dc0-0530-4969-b7dc-88b80727bb57\" (UID: \"08a01dc0-0530-4969-b7dc-88b80727bb57\") " Jul 28 16:27:44.240491 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.240463 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-util\") pod \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " Jul 28 16:27:44.240491 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.240483 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-bundle\") pod \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\" (UID: \"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937\") " Jul 28 16:27:44.241037 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.240507 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-bundle\") pod \"325fff58-1104-4284-a02a-b3b38f8deab0\" (UID: \"325fff58-1104-4284-a02a-b3b38f8deab0\") " Jul 28 16:27:44.241720 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.241356 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-bundle" (OuterVolumeSpecName: "bundle") pod "325fff58-1104-4284-a02a-b3b38f8deab0" (UID: "325fff58-1104-4284-a02a-b3b38f8deab0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:44.246120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.241978 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-bundle" (OuterVolumeSpecName: "bundle") pod "08a01dc0-0530-4969-b7dc-88b80727bb57" (UID: "08a01dc0-0530-4969-b7dc-88b80727bb57"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:44.246120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.243106 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-bundle" (OuterVolumeSpecName: "bundle") pod "3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" (UID: "3fc3b1b0-8ab2-4dcf-9dc7-14232d039937"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:44.246120 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.244722 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-kube-api-access-88dtx" (OuterVolumeSpecName: "kube-api-access-88dtx") pod "3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" (UID: "3fc3b1b0-8ab2-4dcf-9dc7-14232d039937"). InnerVolumeSpecName "kube-api-access-88dtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:27:44.246432 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.246402 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/325fff58-1104-4284-a02a-b3b38f8deab0-kube-api-access-8b962" (OuterVolumeSpecName: "kube-api-access-8b962") pod "325fff58-1104-4284-a02a-b3b38f8deab0" (UID: "325fff58-1104-4284-a02a-b3b38f8deab0"). InnerVolumeSpecName "kube-api-access-8b962". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:27:44.247261 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.247235 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a01dc0-0530-4969-b7dc-88b80727bb57-kube-api-access-rppkk" (OuterVolumeSpecName: "kube-api-access-rppkk") pod "08a01dc0-0530-4969-b7dc-88b80727bb57" (UID: "08a01dc0-0530-4969-b7dc-88b80727bb57"). InnerVolumeSpecName "kube-api-access-rppkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:27:44.247338 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.247240 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-util" (OuterVolumeSpecName: "util") pod "325fff58-1104-4284-a02a-b3b38f8deab0" (UID: "325fff58-1104-4284-a02a-b3b38f8deab0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:44.249471 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.249450 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-util" (OuterVolumeSpecName: "util") pod "3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" (UID: "3fc3b1b0-8ab2-4dcf-9dc7-14232d039937"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:44.249603 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.249584 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-util" (OuterVolumeSpecName: "util") pod "08a01dc0-0530-4969-b7dc-88b80727bb57" (UID: "08a01dc0-0530-4969-b7dc-88b80727bb57"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:44.341641 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.341613 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.341641 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.341637 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a01dc0-0530-4969-b7dc-88b80727bb57-util\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.341766 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.341646 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rppkk\" (UniqueName: \"kubernetes.io/projected/08a01dc0-0530-4969-b7dc-88b80727bb57-kube-api-access-rppkk\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.341766 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.341656 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-util\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.341766 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.341664 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.341766 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.341671 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.341766 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.341679 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325fff58-1104-4284-a02a-b3b38f8deab0-util\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.341766 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.341687 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88dtx\" (UniqueName: \"kubernetes.io/projected/3fc3b1b0-8ab2-4dcf-9dc7-14232d039937-kube-api-access-88dtx\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.341766 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.341695 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b962\" (UniqueName: \"kubernetes.io/projected/325fff58-1104-4284-a02a-b3b38f8deab0-kube-api-access-8b962\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:44.785212 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:44.785183 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecec6d38-0da2-4901-98e6-57a8c38fb2c0" path="/var/lib/kubelet/pods/ecec6d38-0da2-4901-98e6-57a8c38fb2c0/volumes" Jul 28 16:27:45.045124 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.045055 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" event={"ID":"3fc3b1b0-8ab2-4dcf-9dc7-14232d039937","Type":"ContainerDied","Data":"ce60ed78d60567f4cccdb92966e2e8d6f14c8bf34fa93a4a955e0852b511dbf6"} Jul 28 16:27:45.045124 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.045112 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce60ed78d60567f4cccdb92966e2e8d6f14c8bf34fa93a4a955e0852b511dbf6" Jul 28 16:27:45.045124 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.045066 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0s4w7x" Jul 28 16:27:45.047301 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.047274 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" event={"ID":"08a01dc0-0530-4969-b7dc-88b80727bb57","Type":"ContainerDied","Data":"fc32314058d36c940e1b037a4d79315944770e0174e124a3c12a18f33190f0c7"} Jul 28 16:27:45.047301 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.047298 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbqzz2p" Jul 28 16:27:45.047466 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.047333 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc32314058d36c940e1b037a4d79315944770e0174e124a3c12a18f33190f0c7" Jul 28 16:27:45.049390 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.049368 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" Jul 28 16:27:45.049501 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.049384 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cql9ft" event={"ID":"325fff58-1104-4284-a02a-b3b38f8deab0","Type":"ContainerDied","Data":"b9e66a7e7d2efcf7c1211001aa2da287b34c53ef922e43f6b78960f4033cd6e5"} Jul 28 16:27:45.049501 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.049427 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9e66a7e7d2efcf7c1211001aa2da287b34c53ef922e43f6b78960f4033cd6e5" Jul 28 16:27:45.190584 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.190560 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:45.249071 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.249042 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c76dx\" (UniqueName: \"kubernetes.io/projected/466b6c49-dd2f-45ad-b121-e294fba55465-kube-api-access-c76dx\") pod \"466b6c49-dd2f-45ad-b121-e294fba55465\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " Jul 28 16:27:45.249185 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.249102 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-util\") pod \"466b6c49-dd2f-45ad-b121-e294fba55465\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " Jul 28 16:27:45.249185 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.249142 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-bundle\") pod \"466b6c49-dd2f-45ad-b121-e294fba55465\" (UID: \"466b6c49-dd2f-45ad-b121-e294fba55465\") " Jul 28 16:27:45.249737 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.249699 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-bundle" (OuterVolumeSpecName: "bundle") pod "466b6c49-dd2f-45ad-b121-e294fba55465" (UID: "466b6c49-dd2f-45ad-b121-e294fba55465"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:45.251026 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.250995 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/466b6c49-dd2f-45ad-b121-e294fba55465-kube-api-access-c76dx" (OuterVolumeSpecName: "kube-api-access-c76dx") pod "466b6c49-dd2f-45ad-b121-e294fba55465" (UID: "466b6c49-dd2f-45ad-b121-e294fba55465"). InnerVolumeSpecName "kube-api-access-c76dx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:27:45.254402 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.254380 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-util" (OuterVolumeSpecName: "util") pod "466b6c49-dd2f-45ad-b121-e294fba55465" (UID: "466b6c49-dd2f-45ad-b121-e294fba55465"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:27:45.350210 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.350156 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c76dx\" (UniqueName: \"kubernetes.io/projected/466b6c49-dd2f-45ad-b121-e294fba55465-kube-api-access-c76dx\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:45.350210 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.350178 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-util\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:45.350210 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:45.350187 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/466b6c49-dd2f-45ad-b121-e294fba55465-bundle\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:27:46.056824 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:46.056774 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" Jul 28 16:27:46.057197 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:46.056794 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dhsnn" event={"ID":"466b6c49-dd2f-45ad-b121-e294fba55465","Type":"ContainerDied","Data":"63eee556423aa24cdeaec4766097a02670aca476d02a34fce480bf3d3a324492"} Jul 28 16:27:46.057197 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:46.056900 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63eee556423aa24cdeaec4766097a02670aca476d02a34fce480bf3d3a324492" Jul 28 16:27:46.974259 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:46.974229 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65db47d57-5gt77" Jul 28 16:27:50.167666 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:50.167619 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:51.091816 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:51.091766 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:52.127969 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:52.127926 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:57.498066 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:57.498028 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:58.133384 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:58.133331 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:59.146541 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:59.146498 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:27:59.251187 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:27:59.251143 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:02.103529 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:02.103474 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:02.565663 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:02.565627 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:04.209359 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:04.209307 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:04.327218 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:04.327188 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:04.465567 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:04.465489 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:04.693661 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:04.693623 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:05.547612 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:05.547576 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:07.344066 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:07.344030 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:11.721722 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:11.721681 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:11.793651 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:11.793612 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:12.324059 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:12.324031 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:12.438105 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:12.438069 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:13.530697 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:13.530663 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:13.627693 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:13.627661 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:22.129256 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:22.129219 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:22.227940 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:22.227910 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:22.565574 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:22.565542 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:22.713416 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:22.713382 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:25.705422 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:25.705376 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:25.805987 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:25.805932 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:27.802303 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:27.802267 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:27.881706 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:27.881674 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:34.746003 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:34.745926 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:34.848912 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:34.848878 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:35.140433 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:35.140342 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:35.238604 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:35.238566 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:35.340757 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:35.340721 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:35.411759 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:35.411685 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:44.729672 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:44.729633 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:44.828211 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:44.828154 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:45.325408 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:45.325371 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:45.413865 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:45.413833 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:48.266755 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:48.266720 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:48.366840 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:48.366799 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:49.111307 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111268 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-gzkrb"] Jul 28 16:28:49.111683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111665 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="466b6c49-dd2f-45ad-b121-e294fba55465" containerName="extract" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111686 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="466b6c49-dd2f-45ad-b121-e294fba55465" containerName="extract" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111700 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="466b6c49-dd2f-45ad-b121-e294fba55465" containerName="util" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111708 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="466b6c49-dd2f-45ad-b121-e294fba55465" containerName="util" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111719 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerName="extract" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111727 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerName="extract" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111738 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerName="util" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111746 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerName="util" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111761 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecec6d38-0da2-4901-98e6-57a8c38fb2c0" containerName="console" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111769 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecec6d38-0da2-4901-98e6-57a8c38fb2c0" containerName="console" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111795 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerName="pull" Jul 28 16:28:49.111774 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111803 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerName="pull" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111813 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="466b6c49-dd2f-45ad-b121-e294fba55465" containerName="pull" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111820 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="466b6c49-dd2f-45ad-b121-e294fba55465" containerName="pull" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111839 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325fff58-1104-4284-a02a-b3b38f8deab0" containerName="util" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111848 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="325fff58-1104-4284-a02a-b3b38f8deab0" containerName="util" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111865 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325fff58-1104-4284-a02a-b3b38f8deab0" containerName="pull" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111873 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="325fff58-1104-4284-a02a-b3b38f8deab0" containerName="pull" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111884 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerName="pull" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111893 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerName="pull" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111906 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325fff58-1104-4284-a02a-b3b38f8deab0" containerName="extract" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111914 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="325fff58-1104-4284-a02a-b3b38f8deab0" containerName="extract" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111923 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerName="extract" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111931 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerName="extract" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111943 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerName="util" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.111951 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerName="util" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.112050 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecec6d38-0da2-4901-98e6-57a8c38fb2c0" containerName="console" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.112061 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="08a01dc0-0530-4969-b7dc-88b80727bb57" containerName="extract" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.112074 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="325fff58-1104-4284-a02a-b3b38f8deab0" containerName="extract" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.112085 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc3b1b0-8ab2-4dcf-9dc7-14232d039937" containerName="extract" Jul 28 16:28:49.112340 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.112095 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="466b6c49-dd2f-45ad-b121-e294fba55465" containerName="extract" Jul 28 16:28:49.116546 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.116524 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-gzkrb" Jul 28 16:28:49.118809 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.118768 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 28 16:28:49.119054 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.119030 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 28 16:28:49.119336 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.119316 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vwgpx\"" Jul 28 16:28:49.123803 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.122755 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gzkrb"] Jul 28 16:28:49.155674 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.155640 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:49.165919 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.165899 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99sh4\" (UniqueName: \"kubernetes.io/projected/c7f1a3a3-d891-4d26-9cc4-a26dac3aea97-kube-api-access-99sh4\") pod \"authorino-b54df94b4-gzkrb\" (UID: \"c7f1a3a3-d891-4d26-9cc4-a26dac3aea97\") " pod="kuadrant-system/authorino-b54df94b4-gzkrb" Jul 28 16:28:49.260296 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.260249 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:49.266201 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.266175 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99sh4\" (UniqueName: \"kubernetes.io/projected/c7f1a3a3-d891-4d26-9cc4-a26dac3aea97-kube-api-access-99sh4\") pod \"authorino-b54df94b4-gzkrb\" (UID: \"c7f1a3a3-d891-4d26-9cc4-a26dac3aea97\") " pod="kuadrant-system/authorino-b54df94b4-gzkrb" Jul 28 16:28:49.274709 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.274682 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99sh4\" (UniqueName: \"kubernetes.io/projected/c7f1a3a3-d891-4d26-9cc4-a26dac3aea97-kube-api-access-99sh4\") pod \"authorino-b54df94b4-gzkrb\" (UID: \"c7f1a3a3-d891-4d26-9cc4-a26dac3aea97\") " pod="kuadrant-system/authorino-b54df94b4-gzkrb" Jul 28 16:28:49.430031 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.429961 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-gzkrb" Jul 28 16:28:49.557674 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:49.557642 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gzkrb"] Jul 28 16:28:49.561221 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:28:49.561194 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7f1a3a3_d891_4d26_9cc4_a26dac3aea97.slice/crio-f8985303318a568c45c37148c931824d921e4283d928b345a5f8d3fd12723b9f WatchSource:0}: Error finding container f8985303318a568c45c37148c931824d921e4283d928b345a5f8d3fd12723b9f: Status 404 returned error can't find the container with id f8985303318a568c45c37148c931824d921e4283d928b345a5f8d3fd12723b9f Jul 28 16:28:50.351483 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:50.351451 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:50.387882 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:50.387852 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-gzkrb" event={"ID":"c7f1a3a3-d891-4d26-9cc4-a26dac3aea97","Type":"ContainerStarted","Data":"f8985303318a568c45c37148c931824d921e4283d928b345a5f8d3fd12723b9f"} Jul 28 16:28:50.449406 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:50.449378 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:52.537984 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:52.537948 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:52.615121 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:52.615089 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:55.052137 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:55.052096 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:55.134237 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:55.134207 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:28:55.414951 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:55.414872 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-gzkrb" event={"ID":"c7f1a3a3-d891-4d26-9cc4-a26dac3aea97","Type":"ContainerStarted","Data":"21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93"} Jul 28 16:28:55.436582 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:28:55.436532 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-gzkrb" podStartSLOduration=1.5307078939999998 podStartE2EDuration="6.436517678s" totalImagesPullingTime="4.905809784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:28:55.434667675 +0000 UTC m=+559.096976926" watchObservedRunningTime="2026-07-28 16:28:55.436517678 +0000 UTC m=+559.098826935" Jul 28 16:29:01.504073 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:29:01.504023 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:29:01.605448 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:29:01.605419 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:29:36.736577 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:29:36.736550 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:29:36.737711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:29:36.737689 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:31:17.744444 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:31:17.744394 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:31:34.748056 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:31:34.747981 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:31:50.597142 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:31:50.597105 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:32:00.565278 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:32:00.565242 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:32:00.665054 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:32:00.665029 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:32:14.185960 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:32:14.185920 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:32:19.084196 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:32:19.084164 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:32:19.185035 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:32:19.185000 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:33:00.378024 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:00.377948 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:33:01.893125 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:01.893080 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:33:01.994140 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:01.994112 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:33:48.249335 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.249302 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gzkrb"] Jul 28 16:33:48.249862 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.249474 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-gzkrb" podUID="c7f1a3a3-d891-4d26-9cc4-a26dac3aea97" containerName="authorino" containerID="cri-o://21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93" gracePeriod=30 Jul 28 16:33:48.262878 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.262843 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:33:48.333164 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.333138 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:33:48.491688 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.491665 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-gzkrb" Jul 28 16:33:48.622408 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.622331 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99sh4\" (UniqueName: \"kubernetes.io/projected/c7f1a3a3-d891-4d26-9cc4-a26dac3aea97-kube-api-access-99sh4\") pod \"c7f1a3a3-d891-4d26-9cc4-a26dac3aea97\" (UID: \"c7f1a3a3-d891-4d26-9cc4-a26dac3aea97\") " Jul 28 16:33:48.624380 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.624355 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7f1a3a3-d891-4d26-9cc4-a26dac3aea97-kube-api-access-99sh4" (OuterVolumeSpecName: "kube-api-access-99sh4") pod "c7f1a3a3-d891-4d26-9cc4-a26dac3aea97" (UID: "c7f1a3a3-d891-4d26-9cc4-a26dac3aea97"). InnerVolumeSpecName "kube-api-access-99sh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:33:48.723521 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.723498 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99sh4\" (UniqueName: \"kubernetes.io/projected/c7f1a3a3-d891-4d26-9cc4-a26dac3aea97-kube-api-access-99sh4\") on node \"ip-10-0-134-69.ec2.internal\" DevicePath \"\"" Jul 28 16:33:48.939884 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.939821 2549 generic.go:356] "Generic (PLEG): container finished" podID="c7f1a3a3-d891-4d26-9cc4-a26dac3aea97" containerID="21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93" exitCode=0 Jul 28 16:33:48.939884 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.939863 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-gzkrb" Jul 28 16:33:48.940032 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.939903 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-gzkrb" event={"ID":"c7f1a3a3-d891-4d26-9cc4-a26dac3aea97","Type":"ContainerDied","Data":"21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93"} Jul 28 16:33:48.940032 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.939949 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-gzkrb" event={"ID":"c7f1a3a3-d891-4d26-9cc4-a26dac3aea97","Type":"ContainerDied","Data":"f8985303318a568c45c37148c931824d921e4283d928b345a5f8d3fd12723b9f"} Jul 28 16:33:48.940032 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.939966 2549 scope.go:117] "RemoveContainer" containerID="21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93" Jul 28 16:33:48.948611 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.948593 2549 scope.go:117] "RemoveContainer" containerID="21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93" Jul 28 16:33:48.948920 ip-10-0-134-69 kubenswrapper[2549]: E0728 16:33:48.948897 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93\": container with ID starting with 21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93 not found: ID does not exist" containerID="21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93" Jul 28 16:33:48.948978 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.948928 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93"} err="failed to get container status \"21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93\": rpc error: code = NotFound desc = could not find container \"21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93\": container with ID starting with 21c055ee62185a47e9e603709840d3f2a76cd461aec95ae7134084cbc8a91b93 not found: ID does not exist" Jul 28 16:33:48.959088 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.959066 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gzkrb"] Jul 28 16:33:48.964223 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:48.964204 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gzkrb"] Jul 28 16:33:50.784772 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:33:50.784736 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7f1a3a3-d891-4d26-9cc4-a26dac3aea97" path="/var/lib/kubelet/pods/c7f1a3a3-d891-4d26-9cc4-a26dac3aea97/volumes" Jul 28 16:34:03.534711 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.534679 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:34:03.635345 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.635308 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:34:03.774575 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.774545 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-7glwt"] Jul 28 16:34:03.774910 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.774897 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f1a3a3-d891-4d26-9cc4-a26dac3aea97" containerName="authorino" Jul 28 16:34:03.774970 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.774911 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f1a3a3-d891-4d26-9cc4-a26dac3aea97" containerName="authorino" Jul 28 16:34:03.774970 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.774969 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f1a3a3-d891-4d26-9cc4-a26dac3aea97" containerName="authorino" Jul 28 16:34:03.777789 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.777766 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-7glwt" Jul 28 16:34:03.779864 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.779843 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tspnv\"" Jul 28 16:34:03.779989 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.779906 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 28 16:34:03.779989 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.779912 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 28 16:34:03.787022 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.786969 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-7glwt"] Jul 28 16:34:03.800623 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.800581 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:34:03.831876 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.831748 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wk6m\" (UniqueName: \"kubernetes.io/projected/350b58af-d20b-4300-be5e-4d5ad3cbd0e9-kube-api-access-4wk6m\") pod \"authorino-b54df94b4-7glwt\" (UID: \"350b58af-d20b-4300-be5e-4d5ad3cbd0e9\") " pod="kuadrant-system/authorino-b54df94b4-7glwt" Jul 28 16:34:03.901761 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.901735 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:34:03.932854 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.932823 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wk6m\" (UniqueName: \"kubernetes.io/projected/350b58af-d20b-4300-be5e-4d5ad3cbd0e9-kube-api-access-4wk6m\") pod \"authorino-b54df94b4-7glwt\" (UID: \"350b58af-d20b-4300-be5e-4d5ad3cbd0e9\") " pod="kuadrant-system/authorino-b54df94b4-7glwt" Jul 28 16:34:03.941661 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:03.941638 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wk6m\" (UniqueName: \"kubernetes.io/projected/350b58af-d20b-4300-be5e-4d5ad3cbd0e9-kube-api-access-4wk6m\") pod \"authorino-b54df94b4-7glwt\" (UID: \"350b58af-d20b-4300-be5e-4d5ad3cbd0e9\") " pod="kuadrant-system/authorino-b54df94b4-7glwt" Jul 28 16:34:04.087937 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:04.087861 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-7glwt" Jul 28 16:34:04.216484 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:04.216457 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-7glwt"] Jul 28 16:34:04.219251 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:34:04.219213 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod350b58af_d20b_4300_be5e_4d5ad3cbd0e9.slice/crio-44233cb3f03390ef97920661c5d54ed18bc275f94d4a556826510fe74a3a2e57 WatchSource:0}: Error finding container 44233cb3f03390ef97920661c5d54ed18bc275f94d4a556826510fe74a3a2e57: Status 404 returned error can't find the container with id 44233cb3f03390ef97920661c5d54ed18bc275f94d4a556826510fe74a3a2e57 Jul 28 16:34:04.220407 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:04.220389 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:34:05.030662 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:05.030633 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-7glwt" event={"ID":"350b58af-d20b-4300-be5e-4d5ad3cbd0e9","Type":"ContainerStarted","Data":"44233cb3f03390ef97920661c5d54ed18bc275f94d4a556826510fe74a3a2e57"} Jul 28 16:34:06.036933 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:06.036897 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-7glwt" event={"ID":"350b58af-d20b-4300-be5e-4d5ad3cbd0e9","Type":"ContainerStarted","Data":"0bdff7e7af4e1e58640c9360280810f625c890eabc96a9e6563e930c111d9230"} Jul 28 16:34:06.054415 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:06.054369 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-7glwt" podStartSLOduration=2.243844869 podStartE2EDuration="3.054354302s" totalImagesPullingTime="810.509433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:34:06.051827979 +0000 UTC m=+869.714137234" watchObservedRunningTime="2026-07-28 16:34:06.054354302 +0000 UTC m=+869.716663558" Jul 28 16:34:36.777570 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:36.777491 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:34:36.781416 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:34:36.781369 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:39:11.150075 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:11.149988 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:12.690166 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:12.690128 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:27.118961 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:27.118927 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7_7a7f7089-a078-46ab-a591-799611eedb7c/istio-proxy/0.log" Jul 28 16:39:27.851318 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:27.851284 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b54df94b4-7glwt_350b58af-d20b-4300-be5e-4d5ad3cbd0e9/authorino/0.log" Jul 28 16:39:33.866665 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:33.866622 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:34.033465 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.033437 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qfsxh/must-gather-hsnbm"] Jul 28 16:39:34.036849 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.036830 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qfsxh/must-gather-hsnbm" Jul 28 16:39:34.039183 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.039156 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qfsxh\"/\"kube-root-ca.crt\"" Jul 28 16:39:34.039304 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.039161 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qfsxh\"/\"default-dockercfg-5zpcf\"" Jul 28 16:39:34.039304 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.039164 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qfsxh\"/\"openshift-service-ca.crt\"" Jul 28 16:39:34.051588 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.051565 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qfsxh/must-gather-hsnbm"] Jul 28 16:39:34.094685 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.094661 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:34.112028 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.112004 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e5ca15d0-1b9b-4310-b8b2-4318e521850b-must-gather-output\") pod \"must-gather-hsnbm\" (UID: \"e5ca15d0-1b9b-4310-b8b2-4318e521850b\") " pod="openshift-must-gather-qfsxh/must-gather-hsnbm" Jul 28 16:39:34.112129 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.112060 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgxxn\" (UniqueName: \"kubernetes.io/projected/e5ca15d0-1b9b-4310-b8b2-4318e521850b-kube-api-access-zgxxn\") pod \"must-gather-hsnbm\" (UID: \"e5ca15d0-1b9b-4310-b8b2-4318e521850b\") " pod="openshift-must-gather-qfsxh/must-gather-hsnbm" Jul 28 16:39:34.212669 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.212646 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e5ca15d0-1b9b-4310-b8b2-4318e521850b-must-gather-output\") pod \"must-gather-hsnbm\" (UID: \"e5ca15d0-1b9b-4310-b8b2-4318e521850b\") " pod="openshift-must-gather-qfsxh/must-gather-hsnbm" Jul 28 16:39:34.212755 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.212691 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgxxn\" (UniqueName: \"kubernetes.io/projected/e5ca15d0-1b9b-4310-b8b2-4318e521850b-kube-api-access-zgxxn\") pod \"must-gather-hsnbm\" (UID: \"e5ca15d0-1b9b-4310-b8b2-4318e521850b\") " pod="openshift-must-gather-qfsxh/must-gather-hsnbm" Jul 28 16:39:34.212972 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.212956 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e5ca15d0-1b9b-4310-b8b2-4318e521850b-must-gather-output\") pod \"must-gather-hsnbm\" (UID: \"e5ca15d0-1b9b-4310-b8b2-4318e521850b\") " pod="openshift-must-gather-qfsxh/must-gather-hsnbm" Jul 28 16:39:34.222192 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.222173 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgxxn\" (UniqueName: \"kubernetes.io/projected/e5ca15d0-1b9b-4310-b8b2-4318e521850b-kube-api-access-zgxxn\") pod \"must-gather-hsnbm\" (UID: \"e5ca15d0-1b9b-4310-b8b2-4318e521850b\") " pod="openshift-must-gather-qfsxh/must-gather-hsnbm" Jul 28 16:39:34.260175 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.260149 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:34.346086 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.346067 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qfsxh/must-gather-hsnbm" Jul 28 16:39:34.485219 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.485187 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qfsxh/must-gather-hsnbm"] Jul 28 16:39:34.487486 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:39:34.487459 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5ca15d0_1b9b_4310_b8b2_4318e521850b.slice/crio-5e13aa7e26bebd3fbb05ee0fc55f38b541bccc59a878258fa299fa504dcd7728 WatchSource:0}: Error finding container 5e13aa7e26bebd3fbb05ee0fc55f38b541bccc59a878258fa299fa504dcd7728: Status 404 returned error can't find the container with id 5e13aa7e26bebd3fbb05ee0fc55f38b541bccc59a878258fa299fa504dcd7728 Jul 28 16:39:34.489371 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.489357 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:39:34.703998 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:34.703968 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qfsxh/must-gather-hsnbm" event={"ID":"e5ca15d0-1b9b-4310-b8b2-4318e521850b","Type":"ContainerStarted","Data":"5e13aa7e26bebd3fbb05ee0fc55f38b541bccc59a878258fa299fa504dcd7728"} Jul 28 16:39:35.713850 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:35.713815 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qfsxh/must-gather-hsnbm" event={"ID":"e5ca15d0-1b9b-4310-b8b2-4318e521850b","Type":"ContainerStarted","Data":"0b7f2b8d8cf0a3247672ecdabdcc0e68418d271caa35401c35c57262b9d4bc4c"} Jul 28 16:39:35.714235 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:35.713863 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qfsxh/must-gather-hsnbm" event={"ID":"e5ca15d0-1b9b-4310-b8b2-4318e521850b","Type":"ContainerStarted","Data":"f55550dc3b93f5c0f67677c4936a377d7e82ba0d8afe3f9839a07b6af89b3769"} Jul 28 16:39:35.730826 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:35.730761 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qfsxh/must-gather-hsnbm" podStartSLOduration=1.990452898 podStartE2EDuration="2.730746533s" totalImagesPullingTime="740.293635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:39:35.729857768 +0000 UTC m=+1199.392167024" watchObservedRunningTime="2026-07-28 16:39:35.730746533 +0000 UTC m=+1199.393055789" Jul 28 16:39:36.828231 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:36.828198 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:39:36.831526 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:36.831505 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:39:36.898490 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:36.898456 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9rgxh_af39ac3f-cffd-4cdf-8d42-5cecac6c8b62/global-pull-secret-syncer/0.log" Jul 28 16:39:36.979880 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:36.979845 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" Jul 28 16:39:37.072373 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:37.072343 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-69.ec2.internal_e28380000a136ab02263f0353f8827fd/haproxy/0.log" Jul 28 16:39:40.755013 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:40.754976 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:40.855009 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:40.854963 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:41.855540 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:41.855511 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b54df94b4-7glwt_350b58af-d20b-4300-be5e-4d5ad3cbd0e9/authorino/0.log" Jul 28 16:39:41.888016 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:41.887984 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tq5kw_2075f47f-bac4-4cc1-aa2f-ae97218e259b/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:43.207988 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.207955 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17ea6c54-f619-4fbf-8bf4-c0f158e429a2/alertmanager/0.log" Jul 28 16:39:43.238318 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.238291 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17ea6c54-f619-4fbf-8bf4-c0f158e429a2/config-reloader/0.log" Jul 28 16:39:43.268286 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.268212 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17ea6c54-f619-4fbf-8bf4-c0f158e429a2/kube-rbac-proxy-web/0.log" Jul 28 16:39:43.319907 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.319879 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17ea6c54-f619-4fbf-8bf4-c0f158e429a2/kube-rbac-proxy/0.log" Jul 28 16:39:43.361112 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.361084 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17ea6c54-f619-4fbf-8bf4-c0f158e429a2/kube-rbac-proxy-metric/0.log" Jul 28 16:39:43.423365 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.423340 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17ea6c54-f619-4fbf-8bf4-c0f158e429a2/prom-label-proxy/0.log" Jul 28 16:39:43.460298 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.460228 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17ea6c54-f619-4fbf-8bf4-c0f158e429a2/init-config-reloader/0.log" Jul 28 16:39:43.692825 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.692740 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cb776bcdf-9pgfh_ac3ad3ef-1194-4345-9191-ab769939e8ee/metrics-server/0.log" Jul 28 16:39:43.860004 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.859930 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nr7m7_134c3be6-211f-4c27-9c7b-40beed00fb56/node-exporter/0.log" Jul 28 16:39:43.886326 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.886294 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nr7m7_134c3be6-211f-4c27-9c7b-40beed00fb56/kube-rbac-proxy/0.log" Jul 28 16:39:43.914653 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:43.914625 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nr7m7_134c3be6-211f-4c27-9c7b-40beed00fb56/init-textfile/0.log" Jul 28 16:39:44.386895 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.386853 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-s7txq_32b34ba7-1f89-4a51-9010-a08cf13ee4b7/prometheus-operator/0.log" Jul 28 16:39:44.417392 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.417359 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-s7txq_32b34ba7-1f89-4a51-9010-a08cf13ee4b7/kube-rbac-proxy/0.log" Jul 28 16:39:44.450497 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.450470 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-r978l_bb4b9915-7f46-44ae-b771-410002dcd01c/prometheus-operator-admission-webhook/0.log" Jul 28 16:39:44.495028 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.494993 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-869848f696-mrgjt_cb73e0bb-ff66-4118-8904-d0685d47a806/telemeter-client/0.log" Jul 28 16:39:44.523202 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.523173 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-869848f696-mrgjt_cb73e0bb-ff66-4118-8904-d0685d47a806/reload/0.log" Jul 28 16:39:44.557029 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.557000 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-869848f696-mrgjt_cb73e0bb-ff66-4118-8904-d0685d47a806/kube-rbac-proxy/0.log" Jul 28 16:39:44.607167 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.607139 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79d79494f5-7ghbp_04420891-1256-42ed-8315-c9c88d2c0512/thanos-query/0.log" Jul 28 16:39:44.634728 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.634695 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79d79494f5-7ghbp_04420891-1256-42ed-8315-c9c88d2c0512/kube-rbac-proxy-web/0.log" Jul 28 16:39:44.662316 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.662225 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79d79494f5-7ghbp_04420891-1256-42ed-8315-c9c88d2c0512/kube-rbac-proxy/0.log" Jul 28 16:39:44.694218 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.694186 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79d79494f5-7ghbp_04420891-1256-42ed-8315-c9c88d2c0512/prom-label-proxy/0.log" Jul 28 16:39:44.727916 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.727888 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79d79494f5-7ghbp_04420891-1256-42ed-8315-c9c88d2c0512/kube-rbac-proxy-rules/0.log" Jul 28 16:39:44.751746 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:44.751705 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79d79494f5-7ghbp_04420891-1256-42ed-8315-c9c88d2c0512/kube-rbac-proxy-metrics/0.log" Jul 28 16:39:45.921872 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:45.921836 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb"] Jul 28 16:39:45.927425 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:45.927397 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:45.933755 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:45.933723 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb"] Jul 28 16:39:46.040854 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.040824 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-lib-modules\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.041005 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.040858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-proc\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.041005 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.040943 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-sys\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.041092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.041016 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp494\" (UniqueName: \"kubernetes.io/projected/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-kube-api-access-gp494\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.041092 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.041037 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-podres\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.141980 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.141940 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-sys\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.142243 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.142209 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-sys\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.142408 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.142289 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp494\" (UniqueName: \"kubernetes.io/projected/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-kube-api-access-gp494\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.142548 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.142525 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-podres\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.142644 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.142606 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-lib-modules\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.142702 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.142657 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-proc\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.142810 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.142768 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-podres\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.142861 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.142768 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-lib-modules\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.142861 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.142800 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-proc\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.151854 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.151822 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp494\" (UniqueName: \"kubernetes.io/projected/ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42-kube-api-access-gp494\") pod \"perf-node-gather-daemonset-2chsb\" (UID: \"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42\") " pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.242168 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.242137 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.407716 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.407690 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb"] Jul 28 16:39:46.410651 ip-10-0-134-69 kubenswrapper[2549]: W0728 16:39:46.410619 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podef9fa9f4_0ba6_43e3_a2ea_e0eef7bd6f42.slice/crio-6083ff119b3eaf372c412b285ddadc48045dde6dc64698ec239100fbdb399c65 WatchSource:0}: Error finding container 6083ff119b3eaf372c412b285ddadc48045dde6dc64698ec239100fbdb399c65: Status 404 returned error can't find the container with id 6083ff119b3eaf372c412b285ddadc48045dde6dc64698ec239100fbdb399c65 Jul 28 16:39:46.420525 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.420494 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/2.log" Jul 28 16:39:46.426060 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.426000 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-npccl_5e8b4d7a-6c66-449e-86a7-b9579a311364/console-operator/3.log" Jul 28 16:39:46.800885 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.800806 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" event={"ID":"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42","Type":"ContainerStarted","Data":"dd684dc06ccb1694822ceeebc55f61b75708d92691ad3cb0bf850a922a0d83f5"} Jul 28 16:39:46.800885 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.800863 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" event={"ID":"ef9fa9f4-0ba6-43e3-a2ea-e0eef7bd6f42","Type":"ContainerStarted","Data":"6083ff119b3eaf372c412b285ddadc48045dde6dc64698ec239100fbdb399c65"} Jul 28 16:39:46.801063 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.800897 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:46.821600 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.821553 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" podStartSLOduration=1.821538643 podStartE2EDuration="1.821538643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:39:46.820017153 +0000 UTC m=+1210.482326412" watchObservedRunningTime="2026-07-28 16:39:46.821538643 +0000 UTC m=+1210.483847898" Jul 28 16:39:46.925768 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:46.925738 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-89bd56646-47mhv_f2cdc7e5-3aed-46b8-aede-a3e6c4dc98a9/console/0.log" Jul 28 16:39:48.813271 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:48.813245 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zhqrp_d143b044-60a2-465f-84e7-9d57a496ca40/dns/0.log" Jul 28 16:39:48.838387 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:48.838364 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zhqrp_d143b044-60a2-465f-84e7-9d57a496ca40/kube-rbac-proxy/0.log" Jul 28 16:39:48.925433 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:48.925406 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nlrwd_9f8166bc-ce1e-4979-b234-66c97b474e89/dns-node-resolver/0.log" Jul 28 16:39:49.518295 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:49.518261 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6b6zr_b754674c-43ab-4e8d-a7dd-08330fa21b80/node-ca/0.log" Jul 28 16:39:50.566680 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:50.566622 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7_7a7f7089-a078-46ab-a591-799611eedb7c/istio-proxy/0.log" Jul 28 16:39:51.181790 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:51.181745 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zqpt7_ab309541-8f4a-4b53-8a21-b3ed782a8c3f/serve-healthcheck-canary/0.log" Jul 28 16:39:51.695725 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:51.695690 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mlmm_e78c507b-e4dd-492a-abfc-bbc2c9148d81/kube-rbac-proxy/0.log" Jul 28 16:39:51.729041 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:51.729015 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mlmm_e78c507b-e4dd-492a-abfc-bbc2c9148d81/exporter/0.log" Jul 28 16:39:51.756262 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:51.756223 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mlmm_e78c507b-e4dd-492a-abfc-bbc2c9148d81/extractor/0.log" Jul 28 16:39:52.820339 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:52.820312 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qfsxh/perf-node-gather-daemonset-2chsb" Jul 28 16:39:54.897405 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:54.897336 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65db47d57-5gt77_9e317f2a-5be9-46f8-b528-f883c8829ebd/manager/0.log" Jul 28 16:39:55.068863 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:55.068830 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7_7a7f7089-a078-46ab-a591-799611eedb7c/istio-proxy/0.log" Jul 28 16:39:55.805583 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:55.805552 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-85d8b8ddfc-q6zhg_0818c265-0a0a-40d2-857f-bb7dc97edb61/manager/0.log" Jul 28 16:39:55.894683 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:55.894656 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-84d9876847-wwzdb_bc87c3f0-9293-4f04-b6ac-cb10db4fd785/manager/0.log" Jul 28 16:39:56.210510 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:39:56.210471 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-4vwm7_7a7f7089-a078-46ab-a591-799611eedb7c/istio-proxy/0.log" Jul 28 16:40:01.414528 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:40:01.414496 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd_664cd821-5b25-4de0-be52-c62643b02f1a/kube-storage-version-migrator-operator/1.log" Jul 28 16:40:01.415415 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:40:01.415380 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-78xtd_664cd821-5b25-4de0-be52-c62643b02f1a/kube-storage-version-migrator-operator/0.log" Jul 28 16:40:02.456840 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:40:02.456809 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-679bj_3d121c37-ab34-4006-a089-e7ad58a505a7/kube-multus/0.log" Jul 28 16:40:02.900354 ip-10-0-134-69 kubenswrapper[2549]: I0728 16:40:02.900325 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sfjfd_40ddc838-b9e9-4da9-aab9-f897e6fd2d34/kube-multus-additional-cni-plugins/0.log"