Jul 24 12:37:31.720193 ip-10-0-134-28 systemd[1]: Starting Kubernetes Kubelet... Jul 24 12:37:32.123124 ip-10-0-134-28 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 12:37:32.123124 ip-10-0-134-28 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 12:37:32.123124 ip-10-0-134-28 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 12:37:32.123124 ip-10-0-134-28 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 12:37:32.123124 ip-10-0-134-28 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 12:37:32.124151 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.124063 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 12:37:32.129599 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129582 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:37:32.129599 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129599 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129602 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129606 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129609 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129611 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129614 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129617 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129619 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129622 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129624 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129627 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129629 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129635 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129639 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129641 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129644 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129647 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129649 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129652 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:37:32.129667 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129654 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129657 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129659 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129663 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129666 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129669 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129671 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129674 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129677 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129679 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129682 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129684 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129687 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129690 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129692 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129694 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129697 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129699 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129702 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129704 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:37:32.130131 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129708 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129711 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129714 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129717 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129719 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129722 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129724 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129728 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129732 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129735 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129737 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129740 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129742 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129744 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129748 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129751 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129754 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129756 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129758 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129761 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:37:32.130613 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129764 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129767 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129770 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129772 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129775 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129778 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129781 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129783 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129785 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129788 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129790 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129793 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129795 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129798 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129800 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129804 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129807 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129810 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129812 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129815 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:37:32.131111 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129817 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129819 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129823 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129825 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129827 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129830 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129833 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129835 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129838 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129840 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129843 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129846 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129848 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129851 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129853 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129856 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129858 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129860 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.129863 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130624 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:37:32.131587 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130631 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130634 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130637 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130640 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130643 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130646 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130648 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130651 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130654 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130657 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130660 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130663 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130665 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130667 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130670 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130674 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130677 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130680 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130683 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:37:32.132086 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130686 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130689 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130692 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130695 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130698 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130701 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130704 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130707 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130709 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130712 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130715 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130718 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130721 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130723 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130726 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130728 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130731 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130734 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130737 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130739 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:37:32.132553 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130742 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130744 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130747 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130749 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130752 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130754 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130756 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130759 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130761 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130763 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130766 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130769 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130773 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130777 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130780 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130782 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130785 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130788 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130791 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:37:32.133055 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130794 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130796 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130799 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130801 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130804 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130806 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130809 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130812 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130814 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130817 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130819 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130822 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130825 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130827 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130831 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130835 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130837 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130839 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130842 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130844 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:37:32.133518 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130847 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130849 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130852 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130854 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130857 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130859 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130862 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130864 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130867 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130869 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130886 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130889 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130892 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130896 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130900 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130902 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130905 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130907 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130910 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:37:32.134020 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.130913 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131284 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131289 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131292 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131294 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131297 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131300 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131304 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131306 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131309 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131311 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131314 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131316 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131319 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131321 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131323 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131326 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131329 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131333 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131336 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:37:32.134469 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131339 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131342 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131344 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131347 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131349 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131352 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131354 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131357 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131359 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131361 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131364 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131366 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131368 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131371 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131373 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131376 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131378 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131381 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131383 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131386 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:37:32.135045 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131389 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131391 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131394 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131396 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131398 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131401 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131403 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131406 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131408 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131411 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131413 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131416 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131419 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131422 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131424 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131427 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131430 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131432 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131435 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131437 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:37:32.135527 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131439 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131442 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131444 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131446 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131449 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131452 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131454 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131456 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131459 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131461 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131464 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131466 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131469 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131473 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131476 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131478 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131481 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131483 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131486 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131488 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:37:32.136047 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131491 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131493 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131495 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131498 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131500 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131503 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131505 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131511 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131515 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131518 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131520 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131522 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131525 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131527 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131530 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131532 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131534 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131537 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131540 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:37:32.136528 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.131543 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131654 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131673 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131681 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131686 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131691 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131694 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131698 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131703 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131706 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131709 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131714 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131720 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131725 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131730 2560 flags.go:64] FLAG: --cgroup-root="" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131733 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131736 2560 flags.go:64] FLAG: --client-ca-file="" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131739 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131742 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131746 2560 flags.go:64] FLAG: --cluster-domain="" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131749 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131752 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131755 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131758 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 12:37:32.137005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131762 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131766 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131769 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131773 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131776 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131779 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131782 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131785 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131788 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131792 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131799 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131805 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131810 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131814 2560 flags.go:64] FLAG: --enable-server="true" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131817 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131823 2560 flags.go:64] FLAG: --event-burst="100" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131826 2560 flags.go:64] FLAG: --event-qps="50" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131829 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131832 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131835 2560 flags.go:64] FLAG: --eviction-hard="" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131839 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131842 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131844 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131847 2560 flags.go:64] FLAG: --eviction-soft="" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131850 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 12:37:32.137601 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131853 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131856 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131859 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131862 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131864 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131867 2560 flags.go:64] FLAG: --feature-gates="" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131871 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131908 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131912 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131915 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131918 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131921 2560 flags.go:64] FLAG: --help="false" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131924 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131928 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131931 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131934 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131937 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131942 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131946 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131948 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131951 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131954 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131956 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131969 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 12:37:32.138277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131972 2560 flags.go:64] FLAG: --kube-reserved="" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131975 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131978 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131981 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131984 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131987 2560 flags.go:64] FLAG: --lock-file="" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131990 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131993 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.131996 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132002 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132005 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132007 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132010 2560 flags.go:64] FLAG: --logging-format="text" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132013 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132016 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132020 2560 flags.go:64] FLAG: --manifest-url="" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132023 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132028 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132031 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132035 2560 flags.go:64] FLAG: --max-pods="110" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132038 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132041 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132044 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132047 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132050 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 12:37:32.138901 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132053 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132056 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132066 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132069 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132072 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132075 2560 flags.go:64] FLAG: --pod-cidr="" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132078 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132084 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132087 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132090 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132093 2560 flags.go:64] FLAG: --port="10250" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132096 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132099 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ad2e9a3ff2b41121" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132102 2560 flags.go:64] FLAG: --qos-reserved="" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132105 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132108 2560 flags.go:64] FLAG: --register-node="true" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132111 2560 flags.go:64] FLAG: --register-with-taints="" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132115 2560 flags.go:64] FLAG: --registry-burst="10" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132118 2560 flags.go:64] FLAG: --registry-qps="5" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132121 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132124 2560 flags.go:64] FLAG: --reserved-memory="" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132127 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132130 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132136 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132139 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 12:37:32.139519 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132142 2560 flags.go:64] FLAG: --runonce="false" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132145 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132148 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132151 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132153 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132156 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132159 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132162 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132165 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132167 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132171 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132174 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132176 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132179 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132182 2560 flags.go:64] FLAG: --system-cgroups="" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132185 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132190 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132193 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132195 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132199 2560 flags.go:64] FLAG: --tls-min-version="" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132202 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132205 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132208 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132211 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132213 2560 flags.go:64] FLAG: --v="2" Jul 24 12:37:32.140143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132217 2560 flags.go:64] FLAG: --version="false" Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132221 2560 flags.go:64] FLAG: --vmodule="" Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132225 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.132228 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132356 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132363 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132366 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132369 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132372 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132374 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132377 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132380 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132382 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132385 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132387 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132390 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132392 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132395 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132398 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132401 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:37:32.140743 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132404 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132406 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132409 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132412 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132414 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132416 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132419 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132421 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132425 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132427 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132430 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132432 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132434 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132437 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132439 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132442 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132444 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132448 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132451 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132454 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:37:32.141282 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132456 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132459 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132461 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132463 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132466 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132468 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132470 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132473 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132476 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132479 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132483 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132486 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132489 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132492 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132496 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132499 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132501 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132504 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132507 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:37:32.141770 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132510 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132513 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132515 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132518 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132520 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132523 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132525 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132528 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132530 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132533 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132536 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132538 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132541 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132543 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132546 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132548 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132551 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132553 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132556 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132558 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:37:32.142267 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132561 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132563 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132566 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132568 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132571 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132574 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132576 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132579 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132581 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132584 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132586 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132589 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132591 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132594 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132596 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132599 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132601 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132603 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132606 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132608 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:37:32.142754 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132610 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132613 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132618 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.132621 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.133247 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.139893 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.139912 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.140604 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.140612 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140671 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140676 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140680 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140683 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140686 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:37:32.143251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140689 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140693 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140696 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140700 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140702 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140705 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140707 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140710 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140712 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140715 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140717 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140720 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140722 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140726 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140729 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140732 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140735 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140737 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140739 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140742 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:37:32.143594 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140745 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140748 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140751 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140753 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140757 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140760 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140762 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140765 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140767 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140770 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140772 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140774 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140778 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140782 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140785 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140788 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140791 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140794 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140797 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:37:32.144101 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140800 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140802 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140805 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140807 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140809 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140812 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140814 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140819 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140822 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140825 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140828 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140830 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140832 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140835 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140837 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140840 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140842 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140845 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140847 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:37:32.144557 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140850 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140852 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140854 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140857 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140859 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140862 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140865 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140867 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140869 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140888 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140891 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140894 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140897 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140899 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140902 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140904 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140907 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140910 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140912 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140914 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:37:32.145032 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140917 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140919 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140922 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140926 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140930 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140934 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140939 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140942 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140946 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140950 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140954 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140957 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140960 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140962 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140964 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:37:32.145511 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.140967 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.140972 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141088 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141092 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141095 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141098 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141101 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141103 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141106 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141109 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141112 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141115 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141118 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141122 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:37:32.145889 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141126 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141128 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141131 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141134 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141136 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141139 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141141 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141144 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141146 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141149 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141151 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141153 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141155 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141158 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141161 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141163 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141165 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141168 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141170 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141172 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:37:32.146239 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141175 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141177 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141179 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141182 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141184 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141187 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141189 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141192 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141195 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141197 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141199 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141202 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141204 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141207 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141209 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141211 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141214 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141216 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141219 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141221 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:37:32.146747 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141224 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141226 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141228 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141231 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141233 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141236 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141239 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141241 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141244 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141246 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141248 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141250 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141253 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141255 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141257 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141260 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141262 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141265 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141267 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:37:32.147237 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141269 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141272 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141276 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141279 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141281 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141284 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141288 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141290 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141293 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141296 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141298 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141301 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141303 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141305 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141308 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141310 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141312 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141315 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141318 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141320 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:37:32.147698 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141323 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141325 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141328 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141330 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141332 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141335 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141337 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:32.141340 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.141344 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.141457 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.143437 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.144781 2560 server.go:1019] "Starting client certificate rotation" Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.144900 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.144933 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 12:37:32.148196 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.147297 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 12:37:32.149123 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.149095 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 12:37:32.158537 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.158517 2560 log.go:25] "Validated CRI v1 runtime API" Jul 24 12:37:32.160624 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.160608 2560 log.go:25] "Validated CRI v1 image API" Jul 24 12:37:32.163256 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.163238 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 12:37:32.165510 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.165489 2560 fs.go:135] Filesystem UUIDs: map[36d60cdb-17fc-403f-bdcc-f679bc54e36d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7b82b71b-3cbd-4b0e-9a74-97fe51a36e0d:/dev/nvme0n1p3] Jul 24 12:37:32.165563 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.165511 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 12:37:32.170401 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.170295 2560 manager.go:216] Machine: {Timestamp:2026-07-24 12:37:32.169101461 +0000 UTC m=+0.328417789 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3076369 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec258386b04722c0022d300f82914164 SystemUUID:ec258386-b047-22c0-022d-300f82914164 BootID:f227aace-be8a-401d-94ff-c378f3db941b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:29:08:10:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:29:08:10:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:d7:60:e8:2a:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 12:37:32.170401 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.170398 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 12:37:32.170517 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.170474 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 12:37:32.173133 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.173109 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 12:37:32.173279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.173136 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 12:37:32.173843 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.173833 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 12:37:32.173895 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.173846 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 12:37:32.173895 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.173854 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 12:37:32.174478 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.174467 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 12:37:32.175573 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.175562 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 12:37:32.178340 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.178328 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 24 12:37:32.178455 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.178446 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 12:37:32.179164 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.179151 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 24 12:37:32.179199 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.179170 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 12:37:32.179234 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.179198 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 12:37:32.179234 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.179210 2560 kubelet.go:398] "Adding apiserver pod source" Jul 24 12:37:32.179234 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.179231 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 12:37:32.179594 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.179582 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 12:37:32.179643 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.179601 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 12:37:32.181619 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.181594 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 12:37:32.181756 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.181742 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 12:37:32.183037 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183024 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 12:37:32.183086 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183054 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 12:37:32.183674 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183663 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 12:37:32.183711 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183680 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 12:37:32.183711 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183686 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 12:37:32.183711 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183692 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 12:37:32.183711 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183699 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 12:37:32.183711 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183704 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 12:37:32.183852 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183833 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 12:37:32.183852 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183839 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 12:37:32.183852 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183847 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 12:37:32.183852 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183852 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 12:37:32.183977 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183871 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 12:37:32.183977 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.183902 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 12:37:32.184617 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.184608 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 12:37:32.184617 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.184617 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 12:37:32.188100 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.188086 2560 server.go:1268] "Started kubelet" Jul 24 12:37:32.188207 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.188161 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 12:37:32.188207 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.188174 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 12:37:32.188308 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.188228 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 12:37:32.191164 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.191137 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 12:37:32.191786 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.191751 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 12:37:32.191861 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.191849 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 12:37:32.191813 ip-10-0-134-28 systemd[1]: Started Kubernetes Kubelet. Jul 24 12:37:32.192288 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.192192 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 12:37:32.192974 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.192799 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 24 12:37:32.194618 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.194584 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 12:37:32.198924 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.197934 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-28.ec2.internal.18c53a0c62740f79 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-28.ec2.internal,UID:ip-10-0-134-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-28.ec2.internal,},FirstTimestamp:2026-07-24 12:37:32.188061561 +0000 UTC m=+0.347377888,LastTimestamp:2026-07-24 12:37:32.188061561 +0000 UTC m=+0.347377888,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-28.ec2.internal,}" Jul 24 12:37:32.201408 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.201391 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 12:37:32.201487 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.201457 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 12:37:32.201535 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.201496 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:32.201982 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.201967 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 12:37:32.201982 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.201970 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 12:37:32.202130 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202003 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 12:37:32.202184 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202141 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 24 12:37:32.202184 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202150 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 24 12:37:32.202283 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202270 2560 factory.go:55] Registering systemd factory Jul 24 12:37:32.202322 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202289 2560 factory.go:223] Registration of the systemd container factory successfully Jul 24 12:37:32.202505 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202492 2560 factory.go:153] Registering CRI-O factory Jul 24 12:37:32.202505 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202505 2560 factory.go:223] Registration of the crio container factory successfully Jul 24 12:37:32.202586 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202553 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 12:37:32.202586 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202576 2560 factory.go:103] Registering Raw factory Jul 24 12:37:32.202586 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202587 2560 manager.go:1196] Started watching for new ooms in manager Jul 24 12:37:32.202945 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.202928 2560 manager.go:349] Starting recovery of all containers Jul 24 12:37:32.213121 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.213097 2560 manager.go:354] Recovery completed Jul 24 12:37:32.216019 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.215999 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 12:37:32.216166 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.216146 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 12:37:32.217773 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.217760 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:37:32.220150 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.220132 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:37:32.220222 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.220168 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:37:32.220222 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.220181 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:37:32.220799 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.220780 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 12:37:32.220799 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.220797 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 12:37:32.220933 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.220810 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:37:32.220933 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.220815 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 24 12:37:32.221451 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.221434 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:37:32.221527 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.221462 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:37:32.221527 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.221472 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:37:32.222283 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.222271 2560 policy_none.go:49] "None policy: Start" Jul 24 12:37:32.222349 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.222287 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 12:37:32.222349 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.222298 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 12:37:32.223450 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.223439 2560 policy_none.go:47] "Start" Jul 24 12:37:32.232096 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.232030 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-28.ec2.internal.18c53a0c645db2e2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-28.ec2.internal,UID:ip-10-0-134-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-28.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-28.ec2.internal,},FirstTimestamp:2026-07-24 12:37:32.220150498 +0000 UTC m=+0.379466825,LastTimestamp:2026-07-24 12:37:32.220150498 +0000 UTC m=+0.379466825,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-28.ec2.internal,}" Jul 24 12:37:32.234679 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.234586 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-28.ec2.internal.18c53a0c645e0f8e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-28.ec2.internal,UID:ip-10-0-134-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-28.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-28.ec2.internal,},FirstTimestamp:2026-07-24 12:37:32.220174222 +0000 UTC m=+0.379490553,LastTimestamp:2026-07-24 12:37:32.220174222 +0000 UTC m=+0.379490553,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-28.ec2.internal,}" Jul 24 12:37:32.245950 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.245750 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-28.ec2.internal.18c53a0c645e3a2c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-28.ec2.internal,UID:ip-10-0-134-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-28.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-28.ec2.internal,},FirstTimestamp:2026-07-24 12:37:32.220185132 +0000 UTC m=+0.379501460,LastTimestamp:2026-07-24 12:37:32.220185132 +0000 UTC m=+0.379501460,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-28.ec2.internal,}" Jul 24 12:37:32.247025 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.247009 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-55zpc" Jul 24 12:37:32.253921 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.253836 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-28.ec2.internal.18c53a0c645db2e2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-28.ec2.internal.18c53a0c645db2e2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-28.ec2.internal,UID:ip-10-0-134-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-28.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-28.ec2.internal,},FirstTimestamp:2026-07-24 12:37:32.220150498 +0000 UTC m=+0.379466825,LastTimestamp:2026-07-24 12:37:32.221449949 +0000 UTC m=+0.380766276,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-28.ec2.internal,}" Jul 24 12:37:32.254529 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.254517 2560 manager.go:337] "Starting Device Plugin manager" Jul 24 12:37:32.254561 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.254547 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 12:37:32.254561 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.254556 2560 server.go:87] "Starting device plugin registration server" Jul 24 12:37:32.254832 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.254821 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 12:37:32.254902 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.254834 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 12:37:32.255004 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.254981 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 12:37:32.255140 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.255069 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 12:37:32.255140 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.255079 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 12:37:32.255638 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.255566 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 12:37:32.255638 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.255622 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:32.256142 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.256077 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-28.ec2.internal.18c53a0c645e0f8e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-28.ec2.internal.18c53a0c645e0f8e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-28.ec2.internal,UID:ip-10-0-134-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-28.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-28.ec2.internal,},FirstTimestamp:2026-07-24 12:37:32.220174222 +0000 UTC m=+0.379490553,LastTimestamp:2026-07-24 12:37:32.221466614 +0000 UTC m=+0.380782942,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-28.ec2.internal,}" Jul 24 12:37:32.260604 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.260584 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-55zpc" Jul 24 12:37:32.355346 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.355308 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:37:32.356721 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.356272 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:37:32.356721 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.356306 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:37:32.356721 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.356316 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:37:32.356721 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.356342 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.362563 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.362529 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 12:37:32.364072 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.364053 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 12:37:32.364174 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.364099 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 12:37:32.364174 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.364124 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 12:37:32.364174 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.364161 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 12:37:32.366567 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.366547 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:37:32.370327 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.370314 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.370377 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.370335 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-28.ec2.internal\": node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:32.465230 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.465152 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal"] Jul 24 12:37:32.465230 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.465224 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:37:32.466825 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.466809 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:37:32.466935 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.466840 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:37:32.466935 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.466849 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:37:32.468165 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.468153 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:37:32.468270 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.468255 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.468322 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.468286 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:37:32.468922 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.468903 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:37:32.469019 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.468923 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:37:32.469019 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.468935 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:37:32.469019 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.468946 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:37:32.469019 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.468947 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:37:32.469019 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.468962 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:37:32.470318 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.470298 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.470410 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.470330 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:37:32.471037 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.471021 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:37:32.471110 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.471049 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:37:32.471110 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.471064 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:37:32.475975 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.475958 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:32.492503 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.492478 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-28.ec2.internal\" not found" node="ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.496603 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.496585 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-28.ec2.internal\" not found" node="ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.503764 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.503746 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f8670d84f658402c20684d057cb8783-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"0f8670d84f658402c20684d057cb8783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.503842 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.503773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f8670d84f658402c20684d057cb8783-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"0f8670d84f658402c20684d057cb8783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.503842 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.503793 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0f6325ce07165ebf2e9979367b54cf4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-28.ec2.internal\" (UID: \"f0f6325ce07165ebf2e9979367b54cf4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.576316 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.576284 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:32.604154 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.604126 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f8670d84f658402c20684d057cb8783-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"0f8670d84f658402c20684d057cb8783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.604154 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.604085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f8670d84f658402c20684d057cb8783-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"0f8670d84f658402c20684d057cb8783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.604354 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.604178 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f8670d84f658402c20684d057cb8783-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"0f8670d84f658402c20684d057cb8783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.604354 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.604222 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f8670d84f658402c20684d057cb8783-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"0f8670d84f658402c20684d057cb8783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.604354 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.604241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0f6325ce07165ebf2e9979367b54cf4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-28.ec2.internal\" (UID: \"f0f6325ce07165ebf2e9979367b54cf4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.604354 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.604270 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0f6325ce07165ebf2e9979367b54cf4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-28.ec2.internal\" (UID: \"f0f6325ce07165ebf2e9979367b54cf4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.677270 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.677239 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:32.777843 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.777817 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:32.795013 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.794987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.800328 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:32.800303 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" Jul 24 12:37:32.878732 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.878693 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:32.979436 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:32.979407 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:33.081412 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:33.081329 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:33.096830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.096804 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:37:33.144628 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.144591 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 12:37:33.145161 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.144760 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 12:37:33.145161 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.144788 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 12:37:33.181616 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:33.181575 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found" Jul 24 12:37:33.198437 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.198410 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:37:33.202091 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.202071 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" Jul 24 12:37:33.202210 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.202107 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 12:37:33.224716 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.224685 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 12:37:33.231971 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.231950 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 12:37:33.233785 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.233765 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" Jul 24 12:37:33.256133 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.256108 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 12:37:33.264275 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.264238 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 12:32:32 +0000 UTC" deadline="2028-01-13 17:32:26.838146116 +0000 UTC" Jul 24 12:37:33.264275 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.264273 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12916h54m53.573876899s" Jul 24 12:37:33.343509 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.343427 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sltdd" Jul 24 12:37:33.360671 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.360647 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sltdd" Jul 24 12:37:33.374042 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:33.374003 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8670d84f658402c20684d057cb8783.slice/crio-b7f3140a95b3420df09f39ba2f1062c7a873c00a284a12e25c1c12c4dfc9815b WatchSource:0}: Error finding container b7f3140a95b3420df09f39ba2f1062c7a873c00a284a12e25c1c12c4dfc9815b: Status 404 returned error can't find the container with id b7f3140a95b3420df09f39ba2f1062c7a873c00a284a12e25c1c12c4dfc9815b Jul 24 12:37:33.374489 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:33.374475 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f6325ce07165ebf2e9979367b54cf4.slice/crio-924e05cc917d8d48c2c289a36507256bc047444040eca4b17f980e49c995439c WatchSource:0}: Error finding container 924e05cc917d8d48c2c289a36507256bc047444040eca4b17f980e49c995439c: Status 404 returned error can't find the container with id 924e05cc917d8d48c2c289a36507256bc047444040eca4b17f980e49c995439c Jul 24 12:37:33.380283 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.380266 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 12:37:33.552685 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:33.552641 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:37:34.181493 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.181432 2560 apiserver.go:52] "Watching apiserver" Jul 24 12:37:34.188897 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.188848 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 12:37:34.190412 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.190006 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-64mm7","kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x","openshift-cluster-node-tuning-operator/tuned-xrqb5","openshift-image-registry/node-ca-2m8mt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal","openshift-multus/multus-scm8p","openshift-ovn-kubernetes/ovnkube-node-tn6ch","kube-system/global-pull-secret-syncer-49lt9","openshift-dns/node-resolver-chw2x","openshift-multus/multus-additional-cni-plugins-gd2rn","openshift-multus/network-metrics-daemon-ffwf9","openshift-network-diagnostics/network-check-target-6ndzc","openshift-network-operator/iptables-alerter-dclw4"] Jul 24 12:37:34.192769 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.192287 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:34.193957 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.193611 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:34.193957 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.193692 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:34.194946 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.194919 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.196347 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.196326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.198453 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.198431 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.200259 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.200484 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.201035 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.201244 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.201463 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.201663 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wz8lv\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.201856 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6ltlj\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.202161 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.202830 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.203104 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.203750 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.204064 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.204125 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.204254 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.204300 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.204321 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.204388 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9k8zt\"" Jul 24 12:37:34.204483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.204398 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 12:37:34.208148 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.205810 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.208148 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.207111 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lwzxc\"" Jul 24 12:37:34.208148 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.207383 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t7xlc\"" Jul 24 12:37:34.208148 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.207514 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 12:37:34.208148 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.207687 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 12:37:34.208372 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.208283 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 12:37:34.210548 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.208464 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m87b4\"" Jul 24 12:37:34.210548 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.208487 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 12:37:34.210548 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.209776 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 12:37:34.210548 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.210032 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 12:37:34.210548 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.210296 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nthqm\"" Jul 24 12:37:34.213020 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.213000 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.213233 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.213206 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 12:37:34.213319 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.213289 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 12:37:34.213539 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.213521 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 12:37:34.213539 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.213537 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 12:37:34.214341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214134 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-var-lib-openvswitch\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.214341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.214341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214201 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-kubernetes\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.214341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-sys\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.214341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-var-lib-cni-bin\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.214341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214294 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5xmh\" (UniqueName: \"kubernetes.io/projected/6472575c-2d5c-4ee0-a356-5ca8031ff314-kube-api-access-n5xmh\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.214341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214311 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 12:37:34.214341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-run-openvswitch\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.214341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214343 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-modprobe-d\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214368 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-tuned\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214395 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-cni-dir\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-node-log\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-run-multus-certs\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214555 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a448c04-97c9-47f4-8e5a-1c34f783a56f-tmp\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-os-release\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-host\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-device-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-sys-fs\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6472575c-2d5c-4ee0-a356-5ca8031ff314-cni-binary-copy\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.214805 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214800 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214799 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-var-lib-cni-multus\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.214929 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214956 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d028afd3-7457-4b29-b004-0ded45442fb8-env-overrides\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.214984 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-var-lib-kubelet\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-socket-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drshb\" (UniqueName: \"kubernetes.io/projected/49ab2dab-d7e6-42d9-9133-e0cca11f958d-kube-api-access-drshb\") pod \"node-ca-2m8mt\" (UID: \"49ab2dab-d7e6-42d9-9133-e0cca11f958d\") " pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-slash\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215134 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d028afd3-7457-4b29-b004-0ded45442fb8-ovn-node-metrics-cert\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68d749be-07e2-42c1-a702-6e5fef952f66-kubelet-config\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-var-lib-kubelet\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-hostroot\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-etc-kubernetes\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215299 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49ab2dab-d7e6-42d9-9133-e0cca11f958d-host\") pod \"node-ca-2m8mt\" (UID: \"49ab2dab-d7e6-42d9-9133-e0cca11f958d\") " pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215323 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-kubelet\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215340 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-systemd-units\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.215369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215368 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-run-k8s-cni-cncf-io\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215387 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-run-netns\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215404 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-run-systemd\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215447 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-cni-netd\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215545 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-run\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-conf-dir\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-socket-dir-parent\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215635 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d028afd3-7457-4b29-b004-0ded45442fb8-ovnkube-script-lib\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215694 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68d749be-07e2-42c1-a702-6e5fef952f66-dbus\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215708 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-systemd\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215768 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-system-cni-dir\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215792 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-daemon-config\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.216032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215820 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-registration-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-run-netns\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-log-socket\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.215991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt8m6\" (UniqueName: \"kubernetes.io/projected/d028afd3-7457-4b29-b004-0ded45442fb8-kube-api-access-xt8m6\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9jp5\" (UniqueName: \"kubernetes.io/projected/1a448c04-97c9-47f4-8e5a-1c34f783a56f-kube-api-access-x9jp5\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216075 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-cnibin\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49ab2dab-d7e6-42d9-9133-e0cca11f958d-serviceca\") pod \"node-ca-2m8mt\" (UID: \"49ab2dab-d7e6-42d9-9133-e0cca11f958d\") " pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-etc-openvswitch\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d028afd3-7457-4b29-b004-0ded45442fb8-ovnkube-config\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-lib-modules\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7124c2b3-7b77-4012-85bb-e440204e2775-agent-certs\") pod \"konnectivity-agent-64mm7\" (UID: \"7124c2b3-7b77-4012-85bb-e440204e2775\") " pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216275 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-cni-bin\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216299 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-sysconfig\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-sysctl-d\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216376 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-sysctl-conf\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7124c2b3-7b77-4012-85bb-e440204e2775-konnectivity-ca\") pod \"konnectivity-agent-64mm7\" (UID: \"7124c2b3-7b77-4012-85bb-e440204e2775\") " pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-run-ovn\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.216830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216533 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nr4m\" (UniqueName: \"kubernetes.io/projected/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-kube-api-access-7nr4m\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.217610 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216539 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-grvcz\"" Jul 24 12:37:34.217610 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.216730 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 12:37:34.217610 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.217050 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.221551 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.221529 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 12:37:34.221659 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.221624 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsp55\"" Jul 24 12:37:34.221860 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.221843 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:37:34.221920 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.221906 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 12:37:34.222060 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.222044 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 12:37:34.303733 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.303703 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 12:37:34.317051 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-system-cni-dir\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.317223 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317064 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d104bae1-f9d2-4386-9fed-22d764ba28a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.317223 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-log-socket\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.317223 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317131 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt8m6\" (UniqueName: \"kubernetes.io/projected/d028afd3-7457-4b29-b004-0ded45442fb8-kube-api-access-xt8m6\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.317223 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317159 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9jp5\" (UniqueName: \"kubernetes.io/projected/1a448c04-97c9-47f4-8e5a-1c34f783a56f-kube-api-access-x9jp5\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.317223 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-cnibin\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.317223 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49ab2dab-d7e6-42d9-9133-e0cca11f958d-serviceca\") pod \"node-ca-2m8mt\" (UID: \"49ab2dab-d7e6-42d9-9133-e0cca11f958d\") " pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317234 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317262 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d104bae1-f9d2-4386-9fed-22d764ba28a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317317 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-etc-openvswitch\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317342 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d028afd3-7457-4b29-b004-0ded45442fb8-ovnkube-config\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-lib-modules\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317391 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7124c2b3-7b77-4012-85bb-e440204e2775-agent-certs\") pod \"konnectivity-agent-64mm7\" (UID: \"7124c2b3-7b77-4012-85bb-e440204e2775\") " pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317417 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d104bae1-f9d2-4386-9fed-22d764ba28a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317444 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-cni-bin\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317471 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-sysconfig\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317495 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-sysctl-d\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.317538 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-sysctl-conf\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7124c2b3-7b77-4012-85bb-e440204e2775-konnectivity-ca\") pod \"konnectivity-agent-64mm7\" (UID: \"7124c2b3-7b77-4012-85bb-e440204e2775\") " pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317571 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-run-ovn\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nr4m\" (UniqueName: \"kubernetes.io/projected/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-kube-api-access-7nr4m\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d-iptables-alerter-script\") pod \"iptables-alerter-dclw4\" (UID: \"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d\") " pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-var-lib-openvswitch\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-kubernetes\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317735 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-sys\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-var-lib-cni-bin\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xmh\" (UniqueName: \"kubernetes.io/projected/6472575c-2d5c-4ee0-a356-5ca8031ff314-kube-api-access-n5xmh\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-run-openvswitch\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317839 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-modprobe-d\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-tuned\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317891 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-cni-dir\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317915 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-cnibin\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317942 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2zng\" (UniqueName: \"kubernetes.io/projected/c483e782-957b-400e-85d2-5cbd7b4d021b-kube-api-access-f2zng\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:34.318023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.317991 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-node-log\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318033 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318068 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-run-multus-certs\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e967ad27-492d-4e32-9ecf-4c0aaef59570-hosts-file\") pod \"node-resolver-chw2x\" (UID: \"e967ad27-492d-4e32-9ecf-4c0aaef59570\") " pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d-host-slash\") pod \"iptables-alerter-dclw4\" (UID: \"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d\") " pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a448c04-97c9-47f4-8e5a-1c34f783a56f-tmp\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-os-release\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjhnh\" (UniqueName: \"kubernetes.io/projected/f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d-kube-api-access-kjhnh\") pod \"iptables-alerter-dclw4\" (UID: \"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d\") " pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-host\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318247 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-device-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-sys-fs\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318290 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6472575c-2d5c-4ee0-a356-5ca8031ff314-cni-binary-copy\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318318 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-var-lib-cni-multus\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e967ad27-492d-4e32-9ecf-4c0aaef59570-tmp-dir\") pod \"node-resolver-chw2x\" (UID: \"e967ad27-492d-4e32-9ecf-4c0aaef59570\") " pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318374 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d028afd3-7457-4b29-b004-0ded45442fb8-env-overrides\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318401 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-var-lib-kubelet\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-socket-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.318577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drshb\" (UniqueName: \"kubernetes.io/projected/49ab2dab-d7e6-42d9-9133-e0cca11f958d-kube-api-access-drshb\") pod \"node-ca-2m8mt\" (UID: \"49ab2dab-d7e6-42d9-9133-e0cca11f958d\") " pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318458 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gf5r\" (UniqueName: \"kubernetes.io/projected/d104bae1-f9d2-4386-9fed-22d764ba28a2-kube-api-access-6gf5r\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-slash\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d028afd3-7457-4b29-b004-0ded45442fb8-ovn-node-metrics-cert\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68d749be-07e2-42c1-a702-6e5fef952f66-kubelet-config\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318567 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-var-lib-kubelet\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318591 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-hostroot\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-etc-kubernetes\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49ab2dab-d7e6-42d9-9133-e0cca11f958d-host\") pod \"node-ca-2m8mt\" (UID: \"49ab2dab-d7e6-42d9-9133-e0cca11f958d\") " pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318639 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-os-release\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.318655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-kubelet\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-systemd-units\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319226 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-run-k8s-cni-cncf-io\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319255 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-run-netns\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.319279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-run-systemd\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-cni-netd\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-run\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-conf-dir\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319452 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97g4\" (UniqueName: \"kubernetes.io/projected/e967ad27-492d-4e32-9ecf-4c0aaef59570-kube-api-access-l97g4\") pod \"node-resolver-chw2x\" (UID: \"e967ad27-492d-4e32-9ecf-4c0aaef59570\") " pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-socket-dir-parent\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319548 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d028afd3-7457-4b29-b004-0ded45442fb8-ovnkube-script-lib\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68d749be-07e2-42c1-a702-6e5fef952f66-dbus\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319603 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-systemd\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-system-cni-dir\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319687 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-daemon-config\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319712 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-registration-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.319828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319741 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-run-netns\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.320664 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319849 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-run-netns\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.320664 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.319918 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-log-socket\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.320664 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.320467 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-cnibin\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.320903 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49ab2dab-d7e6-42d9-9133-e0cca11f958d-serviceca\") pod \"node-ca-2m8mt\" (UID: \"49ab2dab-d7e6-42d9-9133-e0cca11f958d\") " pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321017 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-etc-openvswitch\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321045 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-cni-netd\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321065 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-systemd-units\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.321128 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.321187 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret podName:68d749be-07e2-42c1-a702-6e5fef952f66 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:34.821170848 +0000 UTC m=+2.980487188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret") pod "global-pull-secret-syncer-49lt9" (UID: "68d749be-07e2-42c1-a702-6e5fef952f66") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321249 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-sys-fs\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321368 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-run\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321385 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321421 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-conf-dir\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321487 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-socket-dir-parent\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321534 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321565 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-slash\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321633 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68d749be-07e2-42c1-a702-6e5fef952f66-kubelet-config\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321674 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-var-lib-kubelet\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321699 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d028afd3-7457-4b29-b004-0ded45442fb8-ovnkube-config\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321710 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-hostroot\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.321730 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321718 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6472575c-2d5c-4ee0-a356-5ca8031ff314-cni-binary-copy\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321773 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-kubelet\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321787 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-cni-bin\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49ab2dab-d7e6-42d9-9133-e0cca11f958d-host\") pod \"node-ca-2m8mt\" (UID: \"49ab2dab-d7e6-42d9-9133-e0cca11f958d\") " pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.321959 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-lib-modules\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322014 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-device-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322016 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d028afd3-7457-4b29-b004-0ded45442fb8-ovnkube-script-lib\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322018 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-run-k8s-cni-cncf-io\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322097 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-systemd\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322127 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-cni-dir\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322098 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-var-lib-kubelet\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322134 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-run-systemd\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322137 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68d749be-07e2-42c1-a702-6e5fef952f66-dbus\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322167 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-etc-kubernetes\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322203 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-sysconfig\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322218 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-socket-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322254 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-sysctl-d\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322262 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.322688 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322310 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-run-multus-certs\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322335 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322350 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-sysctl-conf\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322364 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-system-cni-dir\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322396 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-os-release\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322418 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-run-netns\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322438 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-host\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322489 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d028afd3-7457-4b29-b004-0ded45442fb8-env-overrides\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322098 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-var-lib-cni-multus\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322549 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-node-log\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322597 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-kubernetes\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322631 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-run-ovn\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322758 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7124c2b3-7b77-4012-85bb-e440204e2775-konnectivity-ca\") pod \"konnectivity-agent-64mm7\" (UID: \"7124c2b3-7b77-4012-85bb-e440204e2775\") " pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322801 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-run-openvswitch\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322817 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-sys\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322848 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-var-lib-openvswitch\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322863 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6472575c-2d5c-4ee0-a356-5ca8031ff314-multus-daemon-config\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322876 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6472575c-2d5c-4ee0-a356-5ca8031ff314-host-var-lib-cni-bin\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.323732 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322900 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-modprobe-d\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.324629 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.322923 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-registration-dir\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.324629 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.323803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d028afd3-7457-4b29-b004-0ded45442fb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.328982 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.326174 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d028afd3-7457-4b29-b004-0ded45442fb8-ovn-node-metrics-cert\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.328982 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.326364 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a448c04-97c9-47f4-8e5a-1c34f783a56f-etc-tuned\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.328982 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.326475 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a448c04-97c9-47f4-8e5a-1c34f783a56f-tmp\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.328982 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.328766 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7124c2b3-7b77-4012-85bb-e440204e2775-agent-certs\") pod \"konnectivity-agent-64mm7\" (UID: \"7124c2b3-7b77-4012-85bb-e440204e2775\") " pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:34.333370 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.333349 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:37:34.333487 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.333385 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:37:34.333487 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.333398 2560 projected.go:196] Error preparing data for projected volume kube-api-access-wtlkv for pod openshift-network-diagnostics/network-check-target-6ndzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:34.333593 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.333526 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv podName:e20441fc-7657-433e-926c-6c8c707528e8 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:34.833497346 +0000 UTC m=+2.992813677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wtlkv" (UniqueName: "kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv") pod "network-check-target-6ndzc" (UID: "e20441fc-7657-433e-926c-6c8c707528e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:34.338344 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.338273 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5xmh\" (UniqueName: \"kubernetes.io/projected/6472575c-2d5c-4ee0-a356-5ca8031ff314-kube-api-access-n5xmh\") pod \"multus-scm8p\" (UID: \"6472575c-2d5c-4ee0-a356-5ca8031ff314\") " pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.338451 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.338279 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt8m6\" (UniqueName: \"kubernetes.io/projected/d028afd3-7457-4b29-b004-0ded45442fb8-kube-api-access-xt8m6\") pod \"ovnkube-node-tn6ch\" (UID: \"d028afd3-7457-4b29-b004-0ded45442fb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.340431 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.340403 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9jp5\" (UniqueName: \"kubernetes.io/projected/1a448c04-97c9-47f4-8e5a-1c34f783a56f-kube-api-access-x9jp5\") pod \"tuned-xrqb5\" (UID: \"1a448c04-97c9-47f4-8e5a-1c34f783a56f\") " pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.341324 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.341297 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nr4m\" (UniqueName: \"kubernetes.io/projected/3fef8e93-9973-4b87-b6e3-c9fd2eb563e7-kube-api-access-7nr4m\") pod \"aws-ebs-csi-driver-node-2h66x\" (UID: \"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.341535 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.341514 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drshb\" (UniqueName: \"kubernetes.io/projected/49ab2dab-d7e6-42d9-9133-e0cca11f958d-kube-api-access-drshb\") pod \"node-ca-2m8mt\" (UID: \"49ab2dab-d7e6-42d9-9133-e0cca11f958d\") " pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.363289 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.363216 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 12:32:33 +0000 UTC" deadline="2028-03-29 07:46:42.475937917 +0000 UTC" Jul 24 12:37:34.363289 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.363280 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14731h9m8.112661437s" Jul 24 12:37:34.370072 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.370008 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" event={"ID":"0f8670d84f658402c20684d057cb8783","Type":"ContainerStarted","Data":"b7f3140a95b3420df09f39ba2f1062c7a873c00a284a12e25c1c12c4dfc9815b"} Jul 24 12:37:34.371483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.371457 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" event={"ID":"f0f6325ce07165ebf2e9979367b54cf4","Type":"ContainerStarted","Data":"924e05cc917d8d48c2c289a36507256bc047444040eca4b17f980e49c995439c"} Jul 24 12:37:34.420330 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97g4\" (UniqueName: \"kubernetes.io/projected/e967ad27-492d-4e32-9ecf-4c0aaef59570-kube-api-access-l97g4\") pod \"node-resolver-chw2x\" (UID: \"e967ad27-492d-4e32-9ecf-4c0aaef59570\") " pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.420496 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420348 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-system-cni-dir\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.420496 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d104bae1-f9d2-4386-9fed-22d764ba28a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.420496 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.420496 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420432 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d104bae1-f9d2-4386-9fed-22d764ba28a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.420496 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:34.420717 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d104bae1-f9d2-4386-9fed-22d764ba28a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.420717 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d-iptables-alerter-script\") pod \"iptables-alerter-dclw4\" (UID: \"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d\") " pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.420717 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420569 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-cnibin\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.420717 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420593 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zng\" (UniqueName: \"kubernetes.io/projected/c483e782-957b-400e-85d2-5cbd7b4d021b-kube-api-access-f2zng\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:34.420717 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420620 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e967ad27-492d-4e32-9ecf-4c0aaef59570-hosts-file\") pod \"node-resolver-chw2x\" (UID: \"e967ad27-492d-4e32-9ecf-4c0aaef59570\") " pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.420717 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d-host-slash\") pod \"iptables-alerter-dclw4\" (UID: \"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d\") " pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.420717 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjhnh\" (UniqueName: \"kubernetes.io/projected/f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d-kube-api-access-kjhnh\") pod \"iptables-alerter-dclw4\" (UID: \"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d\") " pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.420717 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420702 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e967ad27-492d-4e32-9ecf-4c0aaef59570-tmp-dir\") pod \"node-resolver-chw2x\" (UID: \"e967ad27-492d-4e32-9ecf-4c0aaef59570\") " pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.421030 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gf5r\" (UniqueName: \"kubernetes.io/projected/d104bae1-f9d2-4386-9fed-22d764ba28a2-kube-api-access-6gf5r\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.421030 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420761 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-os-release\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.421030 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.420875 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-os-release\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.422059 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.421213 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d-host-slash\") pod \"iptables-alerter-dclw4\" (UID: \"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d\") " pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.422059 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.421288 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e967ad27-492d-4e32-9ecf-4c0aaef59570-hosts-file\") pod \"node-resolver-chw2x\" (UID: \"e967ad27-492d-4e32-9ecf-4c0aaef59570\") " pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.422059 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.421327 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-cnibin\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.422059 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.421518 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e967ad27-492d-4e32-9ecf-4c0aaef59570-tmp-dir\") pod \"node-resolver-chw2x\" (UID: \"e967ad27-492d-4e32-9ecf-4c0aaef59570\") " pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.422059 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.421562 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.422059 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.421582 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d104bae1-f9d2-4386-9fed-22d764ba28a2-system-cni-dir\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.422059 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.421614 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:34.422059 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.421674 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs podName:c483e782-957b-400e-85d2-5cbd7b4d021b nodeName:}" failed. No retries permitted until 2026-07-24 12:37:34.92165578 +0000 UTC m=+3.080972098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs") pod "network-metrics-daemon-ffwf9" (UID: "c483e782-957b-400e-85d2-5cbd7b4d021b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:34.422059 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.421803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d-iptables-alerter-script\") pod \"iptables-alerter-dclw4\" (UID: \"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d\") " pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.422586 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.422169 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d104bae1-f9d2-4386-9fed-22d764ba28a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.422586 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.422190 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d104bae1-f9d2-4386-9fed-22d764ba28a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.422586 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.422229 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d104bae1-f9d2-4386-9fed-22d764ba28a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.444138 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.444061 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gf5r\" (UniqueName: \"kubernetes.io/projected/d104bae1-f9d2-4386-9fed-22d764ba28a2-kube-api-access-6gf5r\") pod \"multus-additional-cni-plugins-gd2rn\" (UID: \"d104bae1-f9d2-4386-9fed-22d764ba28a2\") " pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.444925 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.444881 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zng\" (UniqueName: \"kubernetes.io/projected/c483e782-957b-400e-85d2-5cbd7b4d021b-kube-api-access-f2zng\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:34.446738 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.446710 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjhnh\" (UniqueName: \"kubernetes.io/projected/f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d-kube-api-access-kjhnh\") pod \"iptables-alerter-dclw4\" (UID: \"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d\") " pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.447180 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.447154 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97g4\" (UniqueName: \"kubernetes.io/projected/e967ad27-492d-4e32-9ecf-4c0aaef59570-kube-api-access-l97g4\") pod \"node-resolver-chw2x\" (UID: \"e967ad27-492d-4e32-9ecf-4c0aaef59570\") " pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.515425 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.515388 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:34.529311 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.529288 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scm8p" Jul 24 12:37:34.539334 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.539308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" Jul 24 12:37:34.545072 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.545042 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2m8mt" Jul 24 12:37:34.560281 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.560254 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" Jul 24 12:37:34.569308 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.569278 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:37:34.578579 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.578554 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-chw2x" Jul 24 12:37:34.586365 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.586343 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" Jul 24 12:37:34.594224 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.594198 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dclw4" Jul 24 12:37:34.668842 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.668810 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:37:34.823024 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.822986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:34.823213 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.823164 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:34.823281 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.823237 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret podName:68d749be-07e2-42c1-a702-6e5fef952f66 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:35.82321631 +0000 UTC m=+3.982532644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret") pod "global-pull-secret-syncer-49lt9" (UID: "68d749be-07e2-42c1-a702-6e5fef952f66") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:34.923691 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.923654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:34.923846 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:34.923711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:34.923846 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.923815 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:34.923846 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.923826 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:37:34.923985 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.923848 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:37:34.923985 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.923859 2560 projected.go:196] Error preparing data for projected volume kube-api-access-wtlkv for pod openshift-network-diagnostics/network-check-target-6ndzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:34.923985 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.923881 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs podName:c483e782-957b-400e-85d2-5cbd7b4d021b nodeName:}" failed. No retries permitted until 2026-07-24 12:37:35.923861028 +0000 UTC m=+4.083177344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs") pod "network-metrics-daemon-ffwf9" (UID: "c483e782-957b-400e-85d2-5cbd7b4d021b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:34.923985 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:34.923924 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv podName:e20441fc-7657-433e-926c-6c8c707528e8 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:35.923905383 +0000 UTC m=+4.083221718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtlkv" (UniqueName: "kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv") pod "network-check-target-6ndzc" (UID: "e20441fc-7657-433e-926c-6c8c707528e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:35.364318 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:35.364240 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 12:32:33 +0000 UTC" deadline="2028-02-09 04:50:13.029020823 +0000 UTC" Jul 24 12:37:35.364318 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:35.364312 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13552h12m37.664712855s" Jul 24 12:37:35.364970 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:35.364427 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:35.364970 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:35.364462 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:35.364970 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.364581 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:35.364970 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.364720 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:35.588977 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:35.588922 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode967ad27_492d_4e32_9ecf_4c0aaef59570.slice/crio-6ab1265d0347e8c943cdc0d46b24a30c9c694948beab79317e371aa72de26432 WatchSource:0}: Error finding container 6ab1265d0347e8c943cdc0d46b24a30c9c694948beab79317e371aa72de26432: Status 404 returned error can't find the container with id 6ab1265d0347e8c943cdc0d46b24a30c9c694948beab79317e371aa72de26432 Jul 24 12:37:35.590730 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:35.590649 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd104bae1_f9d2_4386_9fed_22d764ba28a2.slice/crio-de2654bf0aafabdeabbc7549ca712232b8a0403054c3caf0546b7a301aed5025 WatchSource:0}: Error finding container de2654bf0aafabdeabbc7549ca712232b8a0403054c3caf0546b7a301aed5025: Status 404 returned error can't find the container with id de2654bf0aafabdeabbc7549ca712232b8a0403054c3caf0546b7a301aed5025 Jul 24 12:37:35.592297 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:35.592276 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd028afd3_7457_4b29_b004_0ded45442fb8.slice/crio-05d55e1f3b6a5dfc6edd730cb392f273db16a002f45c8ef4387e56bddbbea8e6 WatchSource:0}: Error finding container 05d55e1f3b6a5dfc6edd730cb392f273db16a002f45c8ef4387e56bddbbea8e6: Status 404 returned error can't find the container with id 05d55e1f3b6a5dfc6edd730cb392f273db16a002f45c8ef4387e56bddbbea8e6 Jul 24 12:37:35.595141 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:35.595093 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fef8e93_9973_4b87_b6e3_c9fd2eb563e7.slice/crio-0bac232cf6ecca78ca749090727ccc6cdf3d8df5240644be89291f6884845deb WatchSource:0}: Error finding container 0bac232cf6ecca78ca749090727ccc6cdf3d8df5240644be89291f6884845deb: Status 404 returned error can't find the container with id 0bac232cf6ecca78ca749090727ccc6cdf3d8df5240644be89291f6884845deb Jul 24 12:37:35.597251 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:37:35.597223 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6472575c_2d5c_4ee0_a356_5ca8031ff314.slice/crio-1dfe7e45c687d440b618c9d7fba04196b7ea12fb9c2bb42013451d0e59bd391a WatchSource:0}: Error finding container 1dfe7e45c687d440b618c9d7fba04196b7ea12fb9c2bb42013451d0e59bd391a: Status 404 returned error can't find the container with id 1dfe7e45c687d440b618c9d7fba04196b7ea12fb9c2bb42013451d0e59bd391a Jul 24 12:37:35.831690 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:35.831500 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:35.831798 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.831666 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:35.831798 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.831770 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret podName:68d749be-07e2-42c1-a702-6e5fef952f66 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:37.83175519 +0000 UTC m=+5.991071506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret") pod "global-pull-secret-syncer-49lt9" (UID: "68d749be-07e2-42c1-a702-6e5fef952f66") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:35.932659 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:35.932616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:35.932659 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:35.932660 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:35.932873 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.932755 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:35.932873 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.932783 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:37:35.932873 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.932804 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:37:35.932873 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.932810 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs podName:c483e782-957b-400e-85d2-5cbd7b4d021b nodeName:}" failed. No retries permitted until 2026-07-24 12:37:37.932796495 +0000 UTC m=+6.092112810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs") pod "network-metrics-daemon-ffwf9" (UID: "c483e782-957b-400e-85d2-5cbd7b4d021b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:35.932873 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.932815 2560 projected.go:196] Error preparing data for projected volume kube-api-access-wtlkv for pod openshift-network-diagnostics/network-check-target-6ndzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:35.932873 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:35.932861 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv podName:e20441fc-7657-433e-926c-6c8c707528e8 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:37.932849166 +0000 UTC m=+6.092165483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtlkv" (UniqueName: "kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv") pod "network-check-target-6ndzc" (UID: "e20441fc-7657-433e-926c-6c8c707528e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:35.995324 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:35.995292 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:37:36.368223 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.367683 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:36.368223 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:36.367839 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:36.381385 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.381274 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" event={"ID":"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7","Type":"ContainerStarted","Data":"0bac232cf6ecca78ca749090727ccc6cdf3d8df5240644be89291f6884845deb"} Jul 24 12:37:36.384859 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.384769 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" event={"ID":"d104bae1-f9d2-4386-9fed-22d764ba28a2","Type":"ContainerStarted","Data":"de2654bf0aafabdeabbc7549ca712232b8a0403054c3caf0546b7a301aed5025"} Jul 24 12:37:36.393393 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.393333 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-chw2x" event={"ID":"e967ad27-492d-4e32-9ecf-4c0aaef59570","Type":"ContainerStarted","Data":"6ab1265d0347e8c943cdc0d46b24a30c9c694948beab79317e371aa72de26432"} Jul 24 12:37:36.396397 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.396361 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" event={"ID":"f0f6325ce07165ebf2e9979367b54cf4","Type":"ContainerStarted","Data":"b3c7a359b0b352d4eff3b8ace18770cf079a20686cc6679a7891762907c9757d"} Jul 24 12:37:36.404123 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.404094 2560 generic.go:356] "Generic (PLEG): container finished" podID="0f8670d84f658402c20684d057cb8783" containerID="2ffda0a8dde00401b222dd5e5cfba380f8fd34a2221d5a7e4ffee83a40568b49" exitCode=0 Jul 24 12:37:36.404448 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.404415 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" event={"ID":"0f8670d84f658402c20684d057cb8783","Type":"ContainerDied","Data":"2ffda0a8dde00401b222dd5e5cfba380f8fd34a2221d5a7e4ffee83a40568b49"} Jul 24 12:37:36.410806 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.410685 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerStarted","Data":"05d55e1f3b6a5dfc6edd730cb392f273db16a002f45c8ef4387e56bddbbea8e6"} Jul 24 12:37:36.417618 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.417423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" event={"ID":"1a448c04-97c9-47f4-8e5a-1c34f783a56f","Type":"ContainerStarted","Data":"71a9c2928a9f84e81b19579fb5d3d851029ab4af358744ee2882c9f41b58395a"} Jul 24 12:37:36.418368 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.418127 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" podStartSLOduration=3.418108924 podStartE2EDuration="3.418108924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:37:36.417668177 +0000 UTC m=+4.576984516" watchObservedRunningTime="2026-07-24 12:37:36.418108924 +0000 UTC m=+4.577425266" Jul 24 12:37:36.424878 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.424686 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2m8mt" event={"ID":"49ab2dab-d7e6-42d9-9133-e0cca11f958d","Type":"ContainerStarted","Data":"feb53e6172e621e5ebed624b33244a8a76638272f794ad8da62201ac529a3d81"} Jul 24 12:37:36.437943 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.437619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-64mm7" event={"ID":"7124c2b3-7b77-4012-85bb-e440204e2775","Type":"ContainerStarted","Data":"782fea5c786fb79177eae7fe0475894063b728bc6652033eb545b4f7e8f31275"} Jul 24 12:37:36.442359 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.442314 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dclw4" event={"ID":"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d","Type":"ContainerStarted","Data":"6a1a4d2d193e5744b05bd4441d9b657887b04594dea998eb304b790c0430fd90"} Jul 24 12:37:36.445926 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:36.445891 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scm8p" event={"ID":"6472575c-2d5c-4ee0-a356-5ca8031ff314","Type":"ContainerStarted","Data":"1dfe7e45c687d440b618c9d7fba04196b7ea12fb9c2bb42013451d0e59bd391a"} Jul 24 12:37:37.365172 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:37.365138 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:37.365377 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.365284 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:37.365745 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:37.365725 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:37.365860 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.365840 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:37.456675 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:37.456555 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" event={"ID":"0f8670d84f658402c20684d057cb8783","Type":"ContainerStarted","Data":"431ef7b2fb670029b21056b8e2ef026000ed9895785f45ccfdd4749bf3ecb16b"} Jul 24 12:37:37.480494 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:37.480187 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" podStartSLOduration=4.480163238 podStartE2EDuration="4.480163238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:37:37.479057718 +0000 UTC m=+5.638374062" watchObservedRunningTime="2026-07-24 12:37:37.480163238 +0000 UTC m=+5.639479580" Jul 24 12:37:37.850906 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:37.850862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:37.851111 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.851065 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:37.851199 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.851132 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret podName:68d749be-07e2-42c1-a702-6e5fef952f66 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:41.851111892 +0000 UTC m=+10.010428211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret") pod "global-pull-secret-syncer-49lt9" (UID: "68d749be-07e2-42c1-a702-6e5fef952f66") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:37.951713 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:37.951672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:37.951913 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:37.951753 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:37.951913 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.951897 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:37.952084 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.951983 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs podName:c483e782-957b-400e-85d2-5cbd7b4d021b nodeName:}" failed. No retries permitted until 2026-07-24 12:37:41.951964293 +0000 UTC m=+10.111280623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs") pod "network-metrics-daemon-ffwf9" (UID: "c483e782-957b-400e-85d2-5cbd7b4d021b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:37.952590 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.952567 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:37:37.952673 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.952595 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:37:37.952673 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.952609 2560 projected.go:196] Error preparing data for projected volume kube-api-access-wtlkv for pod openshift-network-diagnostics/network-check-target-6ndzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:37.952673 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:37.952661 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv podName:e20441fc-7657-433e-926c-6c8c707528e8 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:41.952644854 +0000 UTC m=+10.111961179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtlkv" (UniqueName: "kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv") pod "network-check-target-6ndzc" (UID: "e20441fc-7657-433e-926c-6c8c707528e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:38.367865 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:38.367829 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:38.368081 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:38.367992 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:39.364813 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:39.364762 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:39.365278 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:39.364935 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:39.365278 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:39.365074 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:39.365278 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:39.365252 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:40.366541 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:40.366052 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:40.366541 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:40.366197 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:41.365344 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:41.364932 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:41.365344 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:41.364953 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:41.365344 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.365053 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:41.365344 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.365189 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:41.887629 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:41.887588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:41.888136 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.887738 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:41.888136 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.887793 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret podName:68d749be-07e2-42c1-a702-6e5fef952f66 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:49.887773856 +0000 UTC m=+18.047090170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret") pod "global-pull-secret-syncer-49lt9" (UID: "68d749be-07e2-42c1-a702-6e5fef952f66") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:41.988833 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:41.988793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:41.988833 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:41.988837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:41.989057 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.988966 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:41.989057 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.989030 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs podName:c483e782-957b-400e-85d2-5cbd7b4d021b nodeName:}" failed. No retries permitted until 2026-07-24 12:37:49.989009853 +0000 UTC m=+18.148326170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs") pod "network-metrics-daemon-ffwf9" (UID: "c483e782-957b-400e-85d2-5cbd7b4d021b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:41.989455 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.989435 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:37:41.989455 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.989457 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:37:41.989591 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.989471 2560 projected.go:196] Error preparing data for projected volume kube-api-access-wtlkv for pod openshift-network-diagnostics/network-check-target-6ndzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:41.989591 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:41.989515 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv podName:e20441fc-7657-433e-926c-6c8c707528e8 nodeName:}" failed. No retries permitted until 2026-07-24 12:37:49.989499651 +0000 UTC m=+18.148815979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtlkv" (UniqueName: "kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv") pod "network-check-target-6ndzc" (UID: "e20441fc-7657-433e-926c-6c8c707528e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:42.366160 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:42.366129 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:42.366319 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:42.366253 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:43.365221 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:43.365180 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:43.365718 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:43.365329 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:43.365718 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:43.365672 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:43.365848 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:43.365748 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:44.366792 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:44.366754 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:44.367181 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:44.366860 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:45.365378 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:45.365345 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:45.365556 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:45.365451 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:45.365824 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:45.365798 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:45.365957 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:45.365915 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:46.365242 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:46.365208 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:46.365682 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:46.365339 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:47.365262 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:47.365226 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:47.365699 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:47.365367 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:47.365699 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:47.365428 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:47.365699 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:47.365529 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:48.365270 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:48.365231 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:48.365717 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:48.365373 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:49.365322 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:49.365289 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:49.365742 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:49.365401 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:49.365742 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:49.365463 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:49.365742 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:49.365595 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:49.950358 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:49.950325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:49.950586 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:49.950484 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:49.950586 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:49.950548 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret podName:68d749be-07e2-42c1-a702-6e5fef952f66 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:05.950533411 +0000 UTC m=+34.109849725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret") pod "global-pull-secret-syncer-49lt9" (UID: "68d749be-07e2-42c1-a702-6e5fef952f66") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:37:50.051527 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:50.051489 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:50.051699 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:50.051549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:50.051699 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:50.051659 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:50.051699 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:50.051661 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:37:50.051699 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:50.051684 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:37:50.051699 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:50.051697 2560 projected.go:196] Error preparing data for projected volume kube-api-access-wtlkv for pod openshift-network-diagnostics/network-check-target-6ndzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:50.051896 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:50.051723 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs podName:c483e782-957b-400e-85d2-5cbd7b4d021b nodeName:}" failed. No retries permitted until 2026-07-24 12:38:06.051706139 +0000 UTC m=+34.211022476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs") pod "network-metrics-daemon-ffwf9" (UID: "c483e782-957b-400e-85d2-5cbd7b4d021b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:37:50.051896 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:50.051743 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv podName:e20441fc-7657-433e-926c-6c8c707528e8 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:06.051731439 +0000 UTC m=+34.211047754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtlkv" (UniqueName: "kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv") pod "network-check-target-6ndzc" (UID: "e20441fc-7657-433e-926c-6c8c707528e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:37:50.364367 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:50.364336 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:50.364593 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:50.364450 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:51.364542 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:51.364508 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:51.364972 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:51.364629 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:51.364972 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:51.364691 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:51.364972 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:51.364833 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:52.366017 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:52.365982 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:52.366523 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:52.366085 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:53.364810 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:53.364765 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:53.365005 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:53.364769 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:53.365005 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:53.364928 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:53.365005 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:53.364984 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:54.365015 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:54.364983 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:54.365636 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:54.365093 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:55.365121 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.364681 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:55.365662 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.364708 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:55.365662 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:55.365194 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:55.365662 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:55.365234 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:55.497197 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.497090 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" event={"ID":"1a448c04-97c9-47f4-8e5a-1c34f783a56f","Type":"ContainerStarted","Data":"806a3ce4d8028a862900104ff590745fb0fddb8529e4d51a2d3a17194be3f884"} Jul 24 12:37:55.499085 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.499035 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2m8mt" event={"ID":"49ab2dab-d7e6-42d9-9133-e0cca11f958d","Type":"ContainerStarted","Data":"8fc3ab54539e76b6b21b468c00452400dc3dc991e518f6db49163dac62b82869"} Jul 24 12:37:55.500606 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.500573 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-64mm7" event={"ID":"7124c2b3-7b77-4012-85bb-e440204e2775","Type":"ContainerStarted","Data":"1b5184f21315d9fdd9d027a3a3450649cbde177efaac1016fd52fb3c1645c600"} Jul 24 12:37:55.502128 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.502104 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scm8p" event={"ID":"6472575c-2d5c-4ee0-a356-5ca8031ff314","Type":"ContainerStarted","Data":"a2c3ab625712aaf2593663daa81b80ee9642c6ffe3d79ec3421c62e5b5c2d2d3"} Jul 24 12:37:55.503936 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.503904 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" event={"ID":"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7","Type":"ContainerStarted","Data":"38bdc439901a28749ae141e4e9a3700d0e391ca70cc9ae0a1c36748ebfbaeb92"} Jul 24 12:37:55.505621 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.505596 2560 generic.go:356] "Generic (PLEG): container finished" podID="d104bae1-f9d2-4386-9fed-22d764ba28a2" containerID="9ba87e9f8698cab465a8fec521399a2f51bbe23a785ee3aefc739d020348e5b9" exitCode=0 Jul 24 12:37:55.505724 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.505687 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" event={"ID":"d104bae1-f9d2-4386-9fed-22d764ba28a2","Type":"ContainerDied","Data":"9ba87e9f8698cab465a8fec521399a2f51bbe23a785ee3aefc739d020348e5b9"} Jul 24 12:37:55.508263 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.508237 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-chw2x" event={"ID":"e967ad27-492d-4e32-9ecf-4c0aaef59570","Type":"ContainerStarted","Data":"0aedbb11b7ac7f073f209988c0ae144f843828a8bec3b10be4bc0a609a902b0a"} Jul 24 12:37:55.513329 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.513310 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovn-acl-logging/0.log" Jul 24 12:37:55.513722 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.513697 2560 generic.go:356] "Generic (PLEG): container finished" podID="d028afd3-7457-4b29-b004-0ded45442fb8" containerID="bb756cf8ef2e75fb8bb296e276c38238b07ec9997740d012dee29210c9b75cf4" exitCode=1 Jul 24 12:37:55.513812 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.513737 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerStarted","Data":"a9cfe640c65523a27277c80639f283539cb97ab28c262b2ca686357ca2a259b5"} Jul 24 12:37:55.513812 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.513806 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerStarted","Data":"574b92c86b5ff25b19e8e2604a75cbf6514bcae59a03f7ce4667774cb86c2bca"} Jul 24 12:37:55.513938 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.513855 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerStarted","Data":"9c7a73285c5f65aa3c21bf8716a1e900f423623b3ea51289782a4e849b144c19"} Jul 24 12:37:55.513938 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.513926 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerStarted","Data":"7523ab3b1def9202e043cc151d9b745c71c506c11939020813afaf73ebba4541"} Jul 24 12:37:55.514043 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.513973 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerDied","Data":"bb756cf8ef2e75fb8bb296e276c38238b07ec9997740d012dee29210c9b75cf4"} Jul 24 12:37:55.514043 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.514021 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerStarted","Data":"261a427fbf21d771118a39beed86307a34f9ec54d81c78457df3a09762a84998"} Jul 24 12:37:55.572577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.572517 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xrqb5" podStartSLOduration=3.580999489 podStartE2EDuration="22.572499912s" totalImagesPullingTime="18.991500423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:37:55.535069071 +0000 UTC m=+23.694385406" watchObservedRunningTime="2026-07-24 12:37:55.572499912 +0000 UTC m=+23.731816247" Jul 24 12:37:55.616136 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.616091 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-chw2x" podStartSLOduration=3.611584786 podStartE2EDuration="22.616075767s" totalImagesPullingTime="19.004490981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:37:55.573293411 +0000 UTC m=+23.732609743" watchObservedRunningTime="2026-07-24 12:37:55.616075767 +0000 UTC m=+23.775392102" Jul 24 12:37:55.645518 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.645478 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-64mm7" podStartSLOduration=8.992904347 podStartE2EDuration="23.645464101s" totalImagesPullingTime="14.652559754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:37:55.642096234 +0000 UTC m=+23.801412570" watchObservedRunningTime="2026-07-24 12:37:55.645464101 +0000 UTC m=+23.804780438" Jul 24 12:37:55.700531 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.700465 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-scm8p" podStartSLOduration=3.685220123 podStartE2EDuration="22.700444424s" totalImagesPullingTime="19.015224301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:37:55.69932549 +0000 UTC m=+23.858641828" watchObservedRunningTime="2026-07-24 12:37:55.700444424 +0000 UTC m=+23.859760763" Jul 24 12:37:55.817322 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.817276 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:37:55.975356 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:55.975324 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:37:56.083312 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.083180 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:37:56.144521 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.144492 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 12:37:56.267031 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.266930 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T12:37:56.14450676Z","UUID":"a05f19fd-ad8f-4840-b3bd-392da0858f29","Handler":null,"Name":"","Endpoint":""} Jul 24 12:37:56.268491 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.268471 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 12:37:56.268597 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.268508 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 12:37:56.305467 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.305435 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:37:56.364837 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.364741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:56.365013 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:56.364927 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:56.409401 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.409368 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:37:56.517966 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.517923 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dclw4" event={"ID":"f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d","Type":"ContainerStarted","Data":"58da07dfe70ddca6abea2151d969ce3ae051899331890ea724cf8cdad3bad4b9"} Jul 24 12:37:56.520366 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.520336 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" event={"ID":"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7","Type":"ContainerStarted","Data":"a65425d8cd1ae59e59929e70fc921bd91bcd101f828f860b3e4a3b1ef28f111b"} Jul 24 12:37:56.576344 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.576292 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dclw4" podStartSLOduration=4.5821590610000005 podStartE2EDuration="23.576269648s" totalImagesPullingTime="18.994110587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:37:56.575235627 +0000 UTC m=+24.734551963" watchObservedRunningTime="2026-07-24 12:37:56.576269648 +0000 UTC m=+24.735585983" Jul 24 12:37:56.576665 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.576590 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2m8mt" podStartSLOduration=4.602738404 podStartE2EDuration="23.576581475s" totalImagesPullingTime="18.973843071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:37:55.747740062 +0000 UTC m=+23.907056398" watchObservedRunningTime="2026-07-24 12:37:56.576581475 +0000 UTC m=+24.735897811" Jul 24 12:37:56.786411 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.786287 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:37:56.939933 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:56.939905 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:37:57.365314 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:57.365282 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:57.365510 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:57.365283 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:57.365510 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:57.365420 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:57.365510 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:57.365495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:57.525715 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:57.525649 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" event={"ID":"3fef8e93-9973-4b87-b6e3-c9fd2eb563e7","Type":"ContainerStarted","Data":"224681a3a577f03ff3274600d7aa2fb07c64b28a2d0a9de99cad61e2097b908b"} Jul 24 12:37:57.529707 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:57.529684 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovn-acl-logging/0.log" Jul 24 12:37:57.530379 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:57.530345 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerStarted","Data":"573d5413107d38c49939d68a8479abaae15ac28d46ed30b1b38eeb296b34837f"} Jul 24 12:37:58.365322 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:58.365284 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:37:58.365507 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:58.365423 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:37:59.365059 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:59.365020 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:37:59.365483 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:59.365067 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:37:59.365483 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:59.365146 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:37:59.365483 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:37:59.365276 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:37:59.561329 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:59.561290 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:37:59.610364 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:59.610170 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:59.610740 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:59.610718 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:37:59.635790 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:59.635719 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2h66x" podStartSLOduration=5.586460958 podStartE2EDuration="26.635698715s" totalImagesPullingTime="21.049237757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:37:57.549346514 +0000 UTC m=+25.708662857" watchObservedRunningTime="2026-07-24 12:37:59.635698715 +0000 UTC m=+27.795015056" Jul 24 12:37:59.692239 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:37:59.692213 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:00.070843 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.070809 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:00.214095 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.214042 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:00.364611 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.364519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:38:00.365351 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:00.365164 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:38:00.540937 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.540913 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovn-acl-logging/0.log" Jul 24 12:38:00.541307 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.541284 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerStarted","Data":"29796c95a1992eedba9879c52d4bb3093decc60252c624273529f2ddc84678c2"} Jul 24 12:38:00.541565 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.541539 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:38:00.541744 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.541728 2560 scope.go:117] "RemoveContainer" containerID="bb756cf8ef2e75fb8bb296e276c38238b07ec9997740d012dee29210c9b75cf4" Jul 24 12:38:00.543195 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.543170 2560 generic.go:356] "Generic (PLEG): container finished" podID="d104bae1-f9d2-4386-9fed-22d764ba28a2" containerID="6571a85713d718488d1c3b7eb286abfed4b5cf73f66076adfce7d448c1162cc5" exitCode=0 Jul 24 12:38:00.543285 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.543253 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" event={"ID":"d104bae1-f9d2-4386-9fed-22d764ba28a2","Type":"ContainerDied","Data":"6571a85713d718488d1c3b7eb286abfed4b5cf73f66076adfce7d448c1162cc5"} Jul 24 12:38:00.560585 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:00.559195 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:38:01.365023 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:01.364807 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:01.365218 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:01.364844 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:01.365218 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:01.365139 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:38:01.365331 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:01.365209 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:38:01.547266 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:01.547236 2560 generic.go:356] "Generic (PLEG): container finished" podID="d104bae1-f9d2-4386-9fed-22d764ba28a2" containerID="8987859f977a66e3740ff48ea3526cb0d4f0a7d8306bf43d3867bc9aba2b7123" exitCode=0 Jul 24 12:38:01.547702 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:01.547324 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" event={"ID":"d104bae1-f9d2-4386-9fed-22d764ba28a2","Type":"ContainerDied","Data":"8987859f977a66e3740ff48ea3526cb0d4f0a7d8306bf43d3867bc9aba2b7123"} Jul 24 12:38:01.551117 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:01.551100 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovn-acl-logging/0.log" Jul 24 12:38:01.551430 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:01.551402 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" event={"ID":"d028afd3-7457-4b29-b004-0ded45442fb8","Type":"ContainerStarted","Data":"55145ed819365c17e396ddf9d41beeeb7f7444ea50536be4faa5796e40aee7e8"} Jul 24 12:38:01.551643 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:01.551625 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:38:01.551723 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:01.551698 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:38:01.567544 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:01.567522 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:38:02.255249 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.255175 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" podStartSLOduration=10.204169148 podStartE2EDuration="29.255152703s" totalImagesPullingTime="19.050983555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:01.644720658 +0000 UTC m=+29.804036993" watchObservedRunningTime="2026-07-24 12:38:02.255152703 +0000 UTC m=+30.414469056" Jul 24 12:38:02.255808 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.255789 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6ndzc"] Jul 24 12:38:02.255952 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.255937 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:02.256064 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:02.256040 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:38:02.257666 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.257641 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ffwf9"] Jul 24 12:38:02.257778 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.257754 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:02.257899 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:02.257859 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:38:02.258313 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.258297 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49lt9"] Jul 24 12:38:02.258400 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.258386 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:38:02.258498 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:02.258478 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:38:02.795183 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.795145 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:38:02.795636 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.795297 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 24 12:38:02.795784 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.795766 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-64mm7" Jul 24 12:38:02.885022 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:02.884927 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:03.364886 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:03.364851 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:03.365032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:03.364914 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:03.365032 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:03.364978 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:38:03.365110 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:03.365093 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:38:03.559291 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:03.559259 2560 generic.go:356] "Generic (PLEG): container finished" podID="d104bae1-f9d2-4386-9fed-22d764ba28a2" containerID="ec4af11b6a4fd3b55065d80407793108ad67a7b23b13363d291bc5ebf522f1b6" exitCode=0 Jul 24 12:38:03.559459 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:03.559335 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" event={"ID":"d104bae1-f9d2-4386-9fed-22d764ba28a2","Type":"ContainerDied","Data":"ec4af11b6a4fd3b55065d80407793108ad67a7b23b13363d291bc5ebf522f1b6"} Jul 24 12:38:04.367215 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:04.367182 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:38:04.367623 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:04.367347 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:38:04.384235 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:04.384201 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:04.503227 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:04.503186 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:05.364917 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:05.364634 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:05.364917 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:05.364666 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:05.364917 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:05.364773 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:38:05.364917 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:05.364857 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:38:05.972304 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:05.972113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:38:05.972691 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:05.972261 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:38:05.972691 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:05.972402 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret podName:68d749be-07e2-42c1-a702-6e5fef952f66 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:37.97238755 +0000 UTC m=+66.131703864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret") pod "global-pull-secret-syncer-49lt9" (UID: "68d749be-07e2-42c1-a702-6e5fef952f66") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:38:06.073431 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:06.073399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:06.073625 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:06.073448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:06.073625 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:06.073543 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:38:06.073625 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:06.073567 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:38:06.073625 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:06.073585 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:38:06.073625 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:06.073597 2560 projected.go:196] Error preparing data for projected volume kube-api-access-wtlkv for pod openshift-network-diagnostics/network-check-target-6ndzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:38:06.073625 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:06.073607 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs podName:c483e782-957b-400e-85d2-5cbd7b4d021b nodeName:}" failed. No retries permitted until 2026-07-24 12:38:38.073589812 +0000 UTC m=+66.232906129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs") pod "network-metrics-daemon-ffwf9" (UID: "c483e782-957b-400e-85d2-5cbd7b4d021b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:38:06.073925 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:06.073652 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv podName:e20441fc-7657-433e-926c-6c8c707528e8 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:38.073634658 +0000 UTC m=+66.232950988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtlkv" (UniqueName: "kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv") pod "network-check-target-6ndzc" (UID: "e20441fc-7657-433e-926c-6c8c707528e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:38:06.365351 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:06.365308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:38:06.365557 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:06.365453 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49lt9" podUID="68d749be-07e2-42c1-a702-6e5fef952f66" Jul 24 12:38:07.364457 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.364415 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:07.364854 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.364433 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:07.364854 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:07.364559 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffwf9" podUID="c483e782-957b-400e-85d2-5cbd7b4d021b" Jul 24 12:38:07.364854 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:07.364593 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ndzc" podUID="e20441fc-7657-433e-926c-6c8c707528e8" Jul 24 12:38:07.703505 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.703439 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeReady" Jul 24 12:38:07.703647 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.703596 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 12:38:07.735522 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.735483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:07.783588 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.783558 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xtwvj"] Jul 24 12:38:07.815716 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.815680 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-48scl"] Jul 24 12:38:07.815898 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.815787 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:07.822726 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.822699 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 12:38:07.822726 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.822714 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rnfsp\"" Jul 24 12:38:07.826269 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.826248 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 12:38:07.831699 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.831677 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-48scl"] Jul 24 12:38:07.831811 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.831708 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xtwvj"] Jul 24 12:38:07.831811 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.831797 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-48scl" Jul 24 12:38:07.834845 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.834500 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7tv4l\"" Jul 24 12:38:07.834845 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.834602 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 12:38:07.834845 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.834713 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 12:38:07.835244 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.835223 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 12:38:07.943277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.943242 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:07.989572 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.989471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:07.989572 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.989522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc26c320-d6f6-490a-aa8a-f1bc610fc9ea-cert\") pod \"ingress-canary-48scl\" (UID: \"dc26c320-d6f6-490a-aa8a-f1bc610fc9ea\") " pod="openshift-ingress-canary/ingress-canary-48scl" Jul 24 12:38:07.989572 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.989561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/040af56e-0b89-4bef-884d-ac4b1654161c-config-volume\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:07.989823 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.989580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksxk6\" (UniqueName: \"kubernetes.io/projected/040af56e-0b89-4bef-884d-ac4b1654161c-kube-api-access-ksxk6\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:07.989823 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.989659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040af56e-0b89-4bef-884d-ac4b1654161c-tmp-dir\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:07.989823 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:07.989701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czbqx\" (UniqueName: \"kubernetes.io/projected/dc26c320-d6f6-490a-aa8a-f1bc610fc9ea-kube-api-access-czbqx\") pod \"ingress-canary-48scl\" (UID: \"dc26c320-d6f6-490a-aa8a-f1bc610fc9ea\") " pod="openshift-ingress-canary/ingress-canary-48scl" Jul 24 12:38:08.048080 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.048042 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:08.091058 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.091019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:08.091058 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.091058 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc26c320-d6f6-490a-aa8a-f1bc610fc9ea-cert\") pod \"ingress-canary-48scl\" (UID: \"dc26c320-d6f6-490a-aa8a-f1bc610fc9ea\") " pod="openshift-ingress-canary/ingress-canary-48scl" Jul 24 12:38:08.091249 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.091104 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/040af56e-0b89-4bef-884d-ac4b1654161c-config-volume\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:08.091249 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:08.091180 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:38:08.091249 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.091227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksxk6\" (UniqueName: \"kubernetes.io/projected/040af56e-0b89-4bef-884d-ac4b1654161c-kube-api-access-ksxk6\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:08.091249 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:08.091240 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls podName:040af56e-0b89-4bef-884d-ac4b1654161c nodeName:}" failed. No retries permitted until 2026-07-24 12:38:08.591221722 +0000 UTC m=+36.750538037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls") pod "dns-default-xtwvj" (UID: "040af56e-0b89-4bef-884d-ac4b1654161c") : secret "dns-default-metrics-tls" not found Jul 24 12:38:08.091413 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.091282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040af56e-0b89-4bef-884d-ac4b1654161c-tmp-dir\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:08.091413 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.091323 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czbqx\" (UniqueName: \"kubernetes.io/projected/dc26c320-d6f6-490a-aa8a-f1bc610fc9ea-kube-api-access-czbqx\") pod \"ingress-canary-48scl\" (UID: \"dc26c320-d6f6-490a-aa8a-f1bc610fc9ea\") " pod="openshift-ingress-canary/ingress-canary-48scl" Jul 24 12:38:08.091619 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.091600 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040af56e-0b89-4bef-884d-ac4b1654161c-tmp-dir\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:08.091733 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.091716 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/040af56e-0b89-4bef-884d-ac4b1654161c-config-volume\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:08.095473 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.095452 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc26c320-d6f6-490a-aa8a-f1bc610fc9ea-cert\") pod \"ingress-canary-48scl\" (UID: \"dc26c320-d6f6-490a-aa8a-f1bc610fc9ea\") " pod="openshift-ingress-canary/ingress-canary-48scl" Jul 24 12:38:08.101595 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.101566 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksxk6\" (UniqueName: \"kubernetes.io/projected/040af56e-0b89-4bef-884d-ac4b1654161c-kube-api-access-ksxk6\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:08.103362 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.103339 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czbqx\" (UniqueName: \"kubernetes.io/projected/dc26c320-d6f6-490a-aa8a-f1bc610fc9ea-kube-api-access-czbqx\") pod \"ingress-canary-48scl\" (UID: \"dc26c320-d6f6-490a-aa8a-f1bc610fc9ea\") " pod="openshift-ingress-canary/ingress-canary-48scl" Jul 24 12:38:08.141418 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.141373 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-48scl" Jul 24 12:38:08.343733 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.343698 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-48scl"] Jul 24 12:38:08.365084 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.365051 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:38:08.368401 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.368379 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 12:38:08.398661 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:08.398626 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc26c320_d6f6_490a_aa8a_f1bc610fc9ea.slice/crio-0169833b1f887c103cc1d88fd9835d9b510bf3826141cb6025ad99736e1363b9 WatchSource:0}: Error finding container 0169833b1f887c103cc1d88fd9835d9b510bf3826141cb6025ad99736e1363b9: Status 404 returned error can't find the container with id 0169833b1f887c103cc1d88fd9835d9b510bf3826141cb6025ad99736e1363b9 Jul 24 12:38:08.575004 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.574700 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" event={"ID":"d104bae1-f9d2-4386-9fed-22d764ba28a2","Type":"ContainerStarted","Data":"d1b60bc5677ef79a65bf061a77806e2eea6f79c90dceb55ad010045eb4d9ab1d"} Jul 24 12:38:08.575981 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.575959 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-48scl" event={"ID":"dc26c320-d6f6-490a-aa8a-f1bc610fc9ea","Type":"ContainerStarted","Data":"0169833b1f887c103cc1d88fd9835d9b510bf3826141cb6025ad99736e1363b9"} Jul 24 12:38:08.596092 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:08.596064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:08.596254 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:08.596235 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:38:08.596310 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:08.596301 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls podName:040af56e-0b89-4bef-884d-ac4b1654161c nodeName:}" failed. No retries permitted until 2026-07-24 12:38:09.596284269 +0000 UTC m=+37.755600587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls") pod "dns-default-xtwvj" (UID: "040af56e-0b89-4bef-884d-ac4b1654161c") : secret "dns-default-metrics-tls" not found Jul 24 12:38:09.253328 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.253275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:09.326076 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.326037 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:09.364989 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.364953 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:09.365169 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.364956 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:09.367605 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.367581 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 12:38:09.367749 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.367666 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8qcf6\"" Jul 24 12:38:09.368632 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.368613 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 12:38:09.368723 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.368613 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 12:38:09.368791 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.368614 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkmsv\"" Jul 24 12:38:09.581524 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.581487 2560 generic.go:356] "Generic (PLEG): container finished" podID="d104bae1-f9d2-4386-9fed-22d764ba28a2" containerID="d1b60bc5677ef79a65bf061a77806e2eea6f79c90dceb55ad010045eb4d9ab1d" exitCode=0 Jul 24 12:38:09.581705 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.581539 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" event={"ID":"d104bae1-f9d2-4386-9fed-22d764ba28a2","Type":"ContainerDied","Data":"d1b60bc5677ef79a65bf061a77806e2eea6f79c90dceb55ad010045eb4d9ab1d"} Jul 24 12:38:09.604409 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:09.604380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:09.604614 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:09.604592 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:38:09.604708 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:09.604695 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls podName:040af56e-0b89-4bef-884d-ac4b1654161c nodeName:}" failed. No retries permitted until 2026-07-24 12:38:11.60467713 +0000 UTC m=+39.763993458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls") pod "dns-default-xtwvj" (UID: "040af56e-0b89-4bef-884d-ac4b1654161c") : secret "dns-default-metrics-tls" not found Jul 24 12:38:10.586891 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:10.586851 2560 generic.go:356] "Generic (PLEG): container finished" podID="d104bae1-f9d2-4386-9fed-22d764ba28a2" containerID="9d4eac0344a2e89b8fcd86494ad5bc8895c25804f8fc426509c8156d1f6cee4c" exitCode=0 Jul 24 12:38:10.587275 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:10.586917 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" event={"ID":"d104bae1-f9d2-4386-9fed-22d764ba28a2","Type":"ContainerDied","Data":"9d4eac0344a2e89b8fcd86494ad5bc8895c25804f8fc426509c8156d1f6cee4c"} Jul 24 12:38:11.130748 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:11.130699 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:11.253197 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:11.253104 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:11.593013 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:11.592967 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" event={"ID":"d104bae1-f9d2-4386-9fed-22d764ba28a2","Type":"ContainerStarted","Data":"670bc7ce86d033fe5b10420b150fa57c8109f96045906f1004eae245856a5016"} Jul 24 12:38:11.594293 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:11.594266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-48scl" event={"ID":"dc26c320-d6f6-490a-aa8a-f1bc610fc9ea","Type":"ContainerStarted","Data":"ea47c55452decabc9a19f7d4a5479bcb8f4385943b6057c4a5bc0ede7b1faee0"} Jul 24 12:38:11.618534 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:11.618504 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:11.618713 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:11.618689 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:38:11.618793 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:11.618779 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls podName:040af56e-0b89-4bef-884d-ac4b1654161c nodeName:}" failed. No retries permitted until 2026-07-24 12:38:15.618755965 +0000 UTC m=+43.778072295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls") pod "dns-default-xtwvj" (UID: "040af56e-0b89-4bef-884d-ac4b1654161c") : secret "dns-default-metrics-tls" not found Jul 24 12:38:11.625783 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:11.625737 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gd2rn" podStartSLOduration=8.880057325 podStartE2EDuration="38.625723432s" totalImagesPullingTime="29.745666107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:11.624619458 +0000 UTC m=+39.783935805" watchObservedRunningTime="2026-07-24 12:38:11.625723432 +0000 UTC m=+39.785039767" Jul 24 12:38:11.649357 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:11.649306 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-48scl" podStartSLOduration=2.152016738 podStartE2EDuration="4.64929054s" totalImagesPullingTime="2.497273802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:11.648199184 +0000 UTC m=+39.807515519" watchObservedRunningTime="2026-07-24 12:38:11.64929054 +0000 UTC m=+39.808606875" Jul 24 12:38:11.783698 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:11.783662 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:11.934461 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:11.934346 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:12.515511 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.515474 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:12.531753 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.531720 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4bl7v"] Jul 24 12:38:12.557283 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.557256 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4bl7v"] Jul 24 12:38:12.557456 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.557402 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.560577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.560552 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 12:38:12.561163 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.561143 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 12:38:12.561163 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.561159 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 12:38:12.561623 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.561604 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 12:38:12.562036 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.562019 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pmfwn\"" Jul 24 12:38:12.695151 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.694954 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:12.727030 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.726994 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f5d4b71-e854-457a-97b2-dbcbefabe000-data-volume\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.727221 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.727200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccv9g\" (UniqueName: \"kubernetes.io/projected/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-api-access-ccv9g\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.727291 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.727277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.727340 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.727310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.727390 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.727379 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f5d4b71-e854-457a-97b2-dbcbefabe000-crio-socket\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.828324 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.828291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f5d4b71-e854-457a-97b2-dbcbefabe000-crio-socket\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.828496 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.828340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f5d4b71-e854-457a-97b2-dbcbefabe000-data-volume\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.828496 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.828395 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccv9g\" (UniqueName: \"kubernetes.io/projected/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-api-access-ccv9g\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.828496 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.828424 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.828496 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.828458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.828671 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:12.828546 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:38:12.828671 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.828558 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f5d4b71-e854-457a-97b2-dbcbefabe000-crio-socket\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.828671 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:12.828609 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:38:12.828671 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:12.828627 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:13.328605975 +0000 UTC m=+41.487922319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : configmap "kube-rbac-proxy" not found Jul 24 12:38:12.828671 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:12.828660 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:13.328643883 +0000 UTC m=+41.487960199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : secret "insights-runtime-extractor-tls" not found Jul 24 12:38:12.829010 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.828758 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f5d4b71-e854-457a-97b2-dbcbefabe000-data-volume\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.846620 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.846588 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccv9g\" (UniqueName: \"kubernetes.io/projected/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-api-access-ccv9g\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:12.871411 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.871367 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:12.949973 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:12.949934 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:13.138379 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.138307 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:13.288459 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.288419 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:13.332422 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.332381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:13.332422 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.332425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:13.332649 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:13.332525 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:38:13.332649 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:13.332531 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:38:13.332649 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:13.332601 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:14.33257973 +0000 UTC m=+42.491896055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : configmap "kube-rbac-proxy" not found Jul 24 12:38:13.332649 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:13.332625 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:14.33261481 +0000 UTC m=+42.491931173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : secret "insights-runtime-extractor-tls" not found Jul 24 12:38:13.792173 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.792140 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr"] Jul 24 12:38:13.815315 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.815282 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr"] Jul 24 12:38:13.815488 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.815421 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr" Jul 24 12:38:13.818032 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.818010 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 12:38:13.818159 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.818055 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 12:38:13.818934 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.818914 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wv7km\"" Jul 24 12:38:13.848760 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.848728 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:13.917950 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.917920 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:13.936951 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:13.936921 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4clc9\" (UniqueName: \"kubernetes.io/projected/e4550148-fac4-478f-b54f-696d8f6ff55b-kube-api-access-4clc9\") pod \"migrator-6865c9967-zhqwr\" (UID: \"e4550148-fac4-478f-b54f-696d8f6ff55b\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr" Jul 24 12:38:14.038165 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:14.038128 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4clc9\" (UniqueName: \"kubernetes.io/projected/e4550148-fac4-478f-b54f-696d8f6ff55b-kube-api-access-4clc9\") pod \"migrator-6865c9967-zhqwr\" (UID: \"e4550148-fac4-478f-b54f-696d8f6ff55b\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr" Jul 24 12:38:14.052397 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:14.052334 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4clc9\" (UniqueName: \"kubernetes.io/projected/e4550148-fac4-478f-b54f-696d8f6ff55b-kube-api-access-4clc9\") pod \"migrator-6865c9967-zhqwr\" (UID: \"e4550148-fac4-478f-b54f-696d8f6ff55b\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr" Jul 24 12:38:14.124651 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:14.124610 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr" Jul 24 12:38:14.273279 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:14.273245 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr"] Jul 24 12:38:14.276238 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:14.276212 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4550148_fac4_478f_b54f_696d8f6ff55b.slice/crio-910c61a44f564e7399e70f8a6415c1539d693509db1296dba89d0742f436cf02 WatchSource:0}: Error finding container 910c61a44f564e7399e70f8a6415c1539d693509db1296dba89d0742f436cf02: Status 404 returned error can't find the container with id 910c61a44f564e7399e70f8a6415c1539d693509db1296dba89d0742f436cf02 Jul 24 12:38:14.341166 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:14.341074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:14.341166 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:14.341119 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:14.341357 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:14.341191 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:38:14.341357 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:14.341258 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:16.341243598 +0000 UTC m=+44.500559912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : configmap "kube-rbac-proxy" not found Jul 24 12:38:14.341357 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:14.341293 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:38:14.341357 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:14.341346 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:16.341333134 +0000 UTC m=+44.500649448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : secret "insights-runtime-extractor-tls" not found Jul 24 12:38:14.441966 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:14.441935 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-chw2x_e967ad27-492d-4e32-9ecf-4c0aaef59570/dns-node-resolver/0.log" Jul 24 12:38:14.602580 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:14.602498 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr" event={"ID":"e4550148-fac4-478f-b54f-696d8f6ff55b","Type":"ContainerStarted","Data":"910c61a44f564e7399e70f8a6415c1539d693509db1296dba89d0742f436cf02"} Jul 24 12:38:14.750811 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:14.750758 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:15.241388 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:15.241359 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2m8mt_49ab2dab-d7e6-42d9-9133-e0cca11f958d/node-ca/0.log" Jul 24 12:38:15.652690 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:15.652656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:15.652868 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:15.652812 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:38:15.652952 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:15.652897 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls podName:040af56e-0b89-4bef-884d-ac4b1654161c nodeName:}" failed. No retries permitted until 2026-07-24 12:38:23.652861404 +0000 UTC m=+51.812177718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls") pod "dns-default-xtwvj" (UID: "040af56e-0b89-4bef-884d-ac4b1654161c") : secret "dns-default-metrics-tls" not found Jul 24 12:38:16.005717 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:16.005678 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:16.044255 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:16.044223 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-48scl_dc26c320-d6f6-490a-aa8a-f1bc610fc9ea/serve-healthcheck-canary/0.log" Jul 24 12:38:16.357487 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:16.357451 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:16.357487 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:16.357489 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:16.357934 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:16.357577 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:38:16.357934 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:16.357589 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:38:16.357934 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:16.357645 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:20.357628929 +0000 UTC m=+48.516945257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : secret "insights-runtime-extractor-tls" not found Jul 24 12:38:16.357934 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:16.357659 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:20.357653014 +0000 UTC m=+48.516969328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : configmap "kube-rbac-proxy" not found Jul 24 12:38:16.608631 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:16.608554 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr" event={"ID":"e4550148-fac4-478f-b54f-696d8f6ff55b","Type":"ContainerStarted","Data":"0f6cb06a3e9b9275777555d1360272195cae6a0043cf4b328ead86647fe16a07"} Jul 24 12:38:16.608631 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:16.608604 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr" event={"ID":"e4550148-fac4-478f-b54f-696d8f6ff55b","Type":"ContainerStarted","Data":"d957f75fd3d61c02234daebec0327fcd7805a56c0e6db1f7461d9ca48698f1d2"} Jul 24 12:38:19.261150 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:19.261114 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:19.403625 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:19.403586 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:19.541270 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:19.541238 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:19.664375 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:19.664342 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:20.049729 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:20.049700 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:20.388859 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:20.388778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:20.389228 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:20.388913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:20.389228 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:20.388965 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:38:20.389228 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:20.388986 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:38:20.389228 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:20.389035 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:28.389016834 +0000 UTC m=+56.548333148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : configmap "kube-rbac-proxy" not found Jul 24 12:38:20.389228 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:20.389051 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:28.389042626 +0000 UTC m=+56.548358940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : secret "insights-runtime-extractor-tls" not found Jul 24 12:38:20.971556 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:20.971525 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:21.211299 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:21.211264 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:21.578554 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:21.578520 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:21.810136 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:21.810096 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:22.400933 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:22.400892 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:22.782748 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:22.782719 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:22.986358 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:22.986320 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:23.237473 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:23.237396 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:23.512311 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:23.512218 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:23.693735 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:23.693698 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:23.715650 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:23.715625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:23.717988 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:23.717968 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/040af56e-0b89-4bef-884d-ac4b1654161c-metrics-tls\") pod \"dns-default-xtwvj\" (UID: \"040af56e-0b89-4bef-884d-ac4b1654161c\") " pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:23.726949 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:23.726926 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:23.878477 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:23.878414 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zhqwr" podStartSLOduration=9.32193841 podStartE2EDuration="10.878397507s" totalImagesPullingTime="1.556459097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:16.644221267 +0000 UTC m=+44.803537602" watchObservedRunningTime="2026-07-24 12:38:23.878397507 +0000 UTC m=+52.037713843" Jul 24 12:38:23.879007 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:23.878990 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xtwvj"] Jul 24 12:38:23.881789 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:23.881765 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040af56e_0b89_4bef_884d_ac4b1654161c.slice/crio-a8f1b560c2860e06f0171f3e9db1610906a61b5010e2af32e39762d6d7a21038 WatchSource:0}: Error finding container a8f1b560c2860e06f0171f3e9db1610906a61b5010e2af32e39762d6d7a21038: Status 404 returned error can't find the container with id a8f1b560c2860e06f0171f3e9db1610906a61b5010e2af32e39762d6d7a21038 Jul 24 12:38:23.975697 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:23.975659 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:24.056723 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:24.056637 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:24.565391 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:24.565349 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:24.629399 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:24.629353 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xtwvj" event={"ID":"040af56e-0b89-4bef-884d-ac4b1654161c","Type":"ContainerStarted","Data":"a8f1b560c2860e06f0171f3e9db1610906a61b5010e2af32e39762d6d7a21038"} Jul 24 12:38:24.808904 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:24.808857 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:25.163799 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:25.163769 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:25.312421 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:25.312367 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:25.454630 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:25.454546 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:25.670000 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:25.669971 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:25.778122 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:25.778093 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:25.908897 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:25.908837 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:26.298046 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:26.298006 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:26.463924 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:26.463867 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:26.620802 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:26.620706 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:26.636674 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:26.636640 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xtwvj" event={"ID":"040af56e-0b89-4bef-884d-ac4b1654161c","Type":"ContainerStarted","Data":"439dc06302f2957bfed9066779411b99067d01b59f4a18d68835df166b64e65b"} Jul 24 12:38:26.636823 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:26.636699 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xtwvj" event={"ID":"040af56e-0b89-4bef-884d-ac4b1654161c","Type":"ContainerStarted","Data":"deb07e23b92101a493a64ea91ba15a26500e1a95f206742ab9d8b2b4044c267f"} Jul 24 12:38:26.636823 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:26.636818 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:26.661182 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:26.661131 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xtwvj" podStartSLOduration=17.919545767 podStartE2EDuration="19.661115274s" totalImagesPullingTime="1.741569507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:26.66062882 +0000 UTC m=+54.819945156" watchObservedRunningTime="2026-07-24 12:38:26.661115274 +0000 UTC m=+54.820431611" Jul 24 12:38:27.356436 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:27.356399 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:27.496045 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:27.496014 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:28.296995 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:28.296961 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:28.414135 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:28.414097 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:28.452177 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:28.452139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:28.452272 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:28.452181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:28.452316 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:28.452274 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:38:28.452351 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:38:28.452336 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls podName:0f5d4b71-e854-457a-97b2-dbcbefabe000 nodeName:}" failed. No retries permitted until 2026-07-24 12:38:44.452322126 +0000 UTC m=+72.611638442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4bl7v" (UID: "0f5d4b71-e854-457a-97b2-dbcbefabe000") : secret "insights-runtime-extractor-tls" not found Jul 24 12:38:28.452652 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:28.452633 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5d4b71-e854-457a-97b2-dbcbefabe000-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:28.995350 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:28.995304 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:29.202994 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:29.202954 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:29.587344 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:29.587314 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:29.812502 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:29.812451 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:29.999148 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:29.999065 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:31.937936 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:31.937900 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:32.061954 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:32.061920 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:32.167086 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:32.167056 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:32.406220 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:32.406194 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:33.571346 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:33.571318 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn6ch" Jul 24 12:38:36.007408 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.007376 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6"] Jul 24 12:38:36.009861 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.009842 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" Jul 24 12:38:36.016465 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.016444 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 12:38:36.016564 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.016465 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7ffvb\"" Jul 24 12:38:36.028132 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.028106 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6"] Jul 24 12:38:36.113036 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.112995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/21eff492-62c8-43b3-b1e8-7a1b8df7a343-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xkrw6\" (UID: \"21eff492-62c8-43b3-b1e8-7a1b8df7a343\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" Jul 24 12:38:36.115965 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.115941 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-567b79bcb-4tsr6"] Jul 24 12:38:36.118091 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.118075 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.122509 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.122472 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 12:38:36.122647 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.122621 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 12:38:36.123086 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.123051 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qx5mb\"" Jul 24 12:38:36.123352 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.123334 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 12:38:36.129045 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.129024 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 12:38:36.140478 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.140450 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-567b79bcb-4tsr6"] Jul 24 12:38:36.162728 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.162685 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:36.213510 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.213479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d2251a2-310c-49dc-906e-50cebc635de8-bound-sa-token\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.213510 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.213512 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78trq\" (UniqueName: \"kubernetes.io/projected/7d2251a2-310c-49dc-906e-50cebc635de8-kube-api-access-78trq\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.213753 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.213552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d2251a2-310c-49dc-906e-50cebc635de8-installation-pull-secrets\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.213753 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.213577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d2251a2-310c-49dc-906e-50cebc635de8-ca-trust-extracted\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.213753 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.213597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d2251a2-310c-49dc-906e-50cebc635de8-registry-certificates\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.213753 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.213613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d2251a2-310c-49dc-906e-50cebc635de8-trusted-ca\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.213753 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.213633 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d2251a2-310c-49dc-906e-50cebc635de8-registry-tls\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.213753 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.213688 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d2251a2-310c-49dc-906e-50cebc635de8-image-registry-private-configuration\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.213985 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.213778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/21eff492-62c8-43b3-b1e8-7a1b8df7a343-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xkrw6\" (UID: \"21eff492-62c8-43b3-b1e8-7a1b8df7a343\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" Jul 24 12:38:36.216292 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.216263 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/21eff492-62c8-43b3-b1e8-7a1b8df7a343-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xkrw6\" (UID: \"21eff492-62c8-43b3-b1e8-7a1b8df7a343\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" Jul 24 12:38:36.271706 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.271617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:36.314757 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.314726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d2251a2-310c-49dc-906e-50cebc635de8-installation-pull-secrets\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.314911 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.314759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d2251a2-310c-49dc-906e-50cebc635de8-ca-trust-extracted\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.314911 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.314776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d2251a2-310c-49dc-906e-50cebc635de8-registry-certificates\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.314911 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.314796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d2251a2-310c-49dc-906e-50cebc635de8-trusted-ca\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.314911 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.314827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d2251a2-310c-49dc-906e-50cebc635de8-registry-tls\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.314911 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.314856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d2251a2-310c-49dc-906e-50cebc635de8-image-registry-private-configuration\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.315144 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.314965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d2251a2-310c-49dc-906e-50cebc635de8-bound-sa-token\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.315144 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.314992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78trq\" (UniqueName: \"kubernetes.io/projected/7d2251a2-310c-49dc-906e-50cebc635de8-kube-api-access-78trq\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.315263 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.315243 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d2251a2-310c-49dc-906e-50cebc635de8-ca-trust-extracted\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.315897 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.315856 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d2251a2-310c-49dc-906e-50cebc635de8-registry-certificates\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.316060 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.316041 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d2251a2-310c-49dc-906e-50cebc635de8-trusted-ca\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.317454 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.317426 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d2251a2-310c-49dc-906e-50cebc635de8-installation-pull-secrets\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.317552 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.317532 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d2251a2-310c-49dc-906e-50cebc635de8-registry-tls\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.317631 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.317611 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d2251a2-310c-49dc-906e-50cebc635de8-image-registry-private-configuration\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.318350 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.318334 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" Jul 24 12:38:36.326283 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.326251 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d2251a2-310c-49dc-906e-50cebc635de8-bound-sa-token\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.338372 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.338347 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78trq\" (UniqueName: \"kubernetes.io/projected/7d2251a2-310c-49dc-906e-50cebc635de8-kube-api-access-78trq\") pod \"image-registry-567b79bcb-4tsr6\" (UID: \"7d2251a2-310c-49dc-906e-50cebc635de8\") " pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.421281 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.421246 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:36.426222 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.426196 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:36.478177 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.478148 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6"] Jul 24 12:38:36.483025 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:36.482981 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21eff492_62c8_43b3_b1e8_7a1b8df7a343.slice/crio-7ca256374f07ad0f3f438df6370207cf64e2984a609918207178a244171f953a WatchSource:0}: Error finding container 7ca256374f07ad0f3f438df6370207cf64e2984a609918207178a244171f953a: Status 404 returned error can't find the container with id 7ca256374f07ad0f3f438df6370207cf64e2984a609918207178a244171f953a Jul 24 12:38:36.621012 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.620983 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-567b79bcb-4tsr6"] Jul 24 12:38:36.623955 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:36.623928 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2251a2_310c_49dc_906e_50cebc635de8.slice/crio-e9a31977cbdc816a7d17c0c5f2fa7bbe7e9ccd3051091c8bc551c422aaed85b5 WatchSource:0}: Error finding container e9a31977cbdc816a7d17c0c5f2fa7bbe7e9ccd3051091c8bc551c422aaed85b5: Status 404 returned error can't find the container with id e9a31977cbdc816a7d17c0c5f2fa7bbe7e9ccd3051091c8bc551c422aaed85b5 Jul 24 12:38:36.643792 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.643772 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xtwvj" Jul 24 12:38:36.668762 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.668733 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" event={"ID":"21eff492-62c8-43b3-b1e8-7a1b8df7a343","Type":"ContainerStarted","Data":"7ca256374f07ad0f3f438df6370207cf64e2984a609918207178a244171f953a"} Jul 24 12:38:36.670609 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.670587 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" event={"ID":"7d2251a2-310c-49dc-906e-50cebc635de8","Type":"ContainerStarted","Data":"e9a31977cbdc816a7d17c0c5f2fa7bbe7e9ccd3051091c8bc551c422aaed85b5"} Jul 24 12:38:36.698366 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:36.698319 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:37.674612 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:37.674575 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" event={"ID":"7d2251a2-310c-49dc-906e-50cebc635de8","Type":"ContainerStarted","Data":"a3192a923fdac7f077b681151cbce8be28ab9e4355185fee40ea93ac7b82aa51"} Jul 24 12:38:37.675144 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:37.674732 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:37.676109 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:37.676088 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" event={"ID":"21eff492-62c8-43b3-b1e8-7a1b8df7a343","Type":"ContainerStarted","Data":"e621648bd6879afd73cf943c07159ef17ec4aa34fe54c92b5990fc584a710764"} Jul 24 12:38:37.676299 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:37.676284 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" Jul 24 12:38:37.680703 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:37.680685 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" Jul 24 12:38:37.719009 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:37.718962 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" podStartSLOduration=1.718946925 podStartE2EDuration="1.718946925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:38:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:37.717773338 +0000 UTC m=+65.877089673" watchObservedRunningTime="2026-07-24 12:38:37.718946925 +0000 UTC m=+65.878263260" Jul 24 12:38:37.795557 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:37.795505 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xkrw6" podStartSLOduration=1.71325492 podStartE2EDuration="2.795487628s" totalImagesPullingTime="1.082232708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:37.781424989 +0000 UTC m=+65.940741324" watchObservedRunningTime="2026-07-24 12:38:37.795487628 +0000 UTC m=+65.954803965" Jul 24 12:38:38.026441 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.026409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:38:38.034393 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.034370 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 12:38:38.039926 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.039902 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68d749be-07e2-42c1-a702-6e5fef952f66-original-pull-secret\") pod \"global-pull-secret-syncer-49lt9\" (UID: \"68d749be-07e2-42c1-a702-6e5fef952f66\") " pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:38:38.074080 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.074050 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lt9" Jul 24 12:38:38.127624 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.127595 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:38.127799 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.127638 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:38.136915 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.136870 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 12:38:38.137048 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.137014 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 12:38:38.140274 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.140251 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c483e782-957b-400e-85d2-5cbd7b4d021b-metrics-certs\") pod \"network-metrics-daemon-ffwf9\" (UID: \"c483e782-957b-400e-85d2-5cbd7b4d021b\") " pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:38.148214 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.148190 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 12:38:38.161637 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.161605 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtlkv\" (UniqueName: \"kubernetes.io/projected/e20441fc-7657-433e-926c-6c8c707528e8-kube-api-access-wtlkv\") pod \"network-check-target-6ndzc\" (UID: \"e20441fc-7657-433e-926c-6c8c707528e8\") " pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:38.170823 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.170796 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:38.181235 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.181211 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8qcf6\"" Jul 24 12:38:38.186192 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.186177 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkmsv\"" Jul 24 12:38:38.188109 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.188096 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffwf9" Jul 24 12:38:38.193370 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.193351 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:38.213442 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.213415 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49lt9"] Jul 24 12:38:38.216206 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:38.216176 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d749be_07e2_42c1_a702_6e5fef952f66.slice/crio-3d9116d76731518281625ca3b51ae6950c5853e40390ad62744b91c71240a038 WatchSource:0}: Error finding container 3d9116d76731518281625ca3b51ae6950c5853e40390ad62744b91c71240a038: Status 404 returned error can't find the container with id 3d9116d76731518281625ca3b51ae6950c5853e40390ad62744b91c71240a038 Jul 24 12:38:38.344934 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.344900 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ffwf9"] Jul 24 12:38:38.345808 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.345781 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:38.352962 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:38.352937 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc483e782_957b_400e_85d2_5cbd7b4d021b.slice/crio-986bc2fcaee3d467cac3f26375533ee5db2c734723229d23df7b9de5d7c16594 WatchSource:0}: Error finding container 986bc2fcaee3d467cac3f26375533ee5db2c734723229d23df7b9de5d7c16594: Status 404 returned error can't find the container with id 986bc2fcaee3d467cac3f26375533ee5db2c734723229d23df7b9de5d7c16594 Jul 24 12:38:38.395227 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.395185 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-l4wz9"] Jul 24 12:38:38.398778 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.398751 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.402215 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.402193 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 12:38:38.403015 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.402996 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 12:38:38.403109 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.403096 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 12:38:38.403164 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.403110 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jwrtq\"" Jul 24 12:38:38.403401 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.403384 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 12:38:38.403462 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.403409 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 12:38:38.430962 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.430933 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.431098 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.430966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.431098 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.430997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.431098 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.431065 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h47p2\" (UniqueName: \"kubernetes.io/projected/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-kube-api-access-h47p2\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.441627 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.441603 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6ndzc"] Jul 24 12:38:38.442618 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.442596 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-l4wz9"] Jul 24 12:38:38.442835 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:38.442818 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20441fc_7657_433e_926c_6c8c707528e8.slice/crio-f85c0feb06e29f598acf186b94e9ba746f9584448177f766c539b5ff5610cb43 WatchSource:0}: Error finding container f85c0feb06e29f598acf186b94e9ba746f9584448177f766c539b5ff5610cb43: Status 404 returned error can't find the container with id f85c0feb06e29f598acf186b94e9ba746f9584448177f766c539b5ff5610cb43 Jul 24 12:38:38.532082 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.532044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h47p2\" (UniqueName: \"kubernetes.io/projected/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-kube-api-access-h47p2\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.532243 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.532108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.532243 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.532129 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.532243 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.532150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.532750 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.532730 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.534644 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.534621 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.534741 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.534721 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.548504 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.548447 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h47p2\" (UniqueName: \"kubernetes.io/projected/28281cb5-b0f5-46cc-bdc1-4845cd5ac4df-kube-api-access-h47p2\") pod \"prometheus-operator-84d69f794d-l4wz9\" (UID: \"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.573698 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.573666 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:38.680863 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.680831 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49lt9" event={"ID":"68d749be-07e2-42c1-a702-6e5fef952f66","Type":"ContainerStarted","Data":"3d9116d76731518281625ca3b51ae6950c5853e40390ad62744b91c71240a038"} Jul 24 12:38:38.682037 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.682009 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6ndzc" event={"ID":"e20441fc-7657-433e-926c-6c8c707528e8","Type":"ContainerStarted","Data":"f85c0feb06e29f598acf186b94e9ba746f9584448177f766c539b5ff5610cb43"} Jul 24 12:38:38.683233 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.683204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffwf9" event={"ID":"c483e782-957b-400e-85d2-5cbd7b4d021b","Type":"ContainerStarted","Data":"986bc2fcaee3d467cac3f26375533ee5db2c734723229d23df7b9de5d7c16594"} Jul 24 12:38:38.707827 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.707797 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" Jul 24 12:38:38.856524 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:38.856502 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-l4wz9"] Jul 24 12:38:38.858611 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:38.858584 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28281cb5_b0f5_46cc_bdc1_4845cd5ac4df.slice/crio-df46e74d1066c382bc08572e107568d5395f778a5698014f379bbdae07220c1b WatchSource:0}: Error finding container df46e74d1066c382bc08572e107568d5395f778a5698014f379bbdae07220c1b: Status 404 returned error can't find the container with id df46e74d1066c382bc08572e107568d5395f778a5698014f379bbdae07220c1b Jul 24 12:38:39.690526 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:39.690449 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" event={"ID":"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df","Type":"ContainerStarted","Data":"df46e74d1066c382bc08572e107568d5395f778a5698014f379bbdae07220c1b"} Jul 24 12:38:39.693377 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:39.692838 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffwf9" event={"ID":"c483e782-957b-400e-85d2-5cbd7b4d021b","Type":"ContainerStarted","Data":"af9ee8d1fecdaf2110add8a3c2e9a5d9d9bde3679fa1db08ae9b7f3043a14532"} Jul 24 12:38:40.705405 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:40.705330 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffwf9" event={"ID":"c483e782-957b-400e-85d2-5cbd7b4d021b","Type":"ContainerStarted","Data":"87caec0921b1e6798a5629bd75882a5bf128f2cc6b6e176fc4bdc5b82576588f"} Jul 24 12:38:40.746682 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:40.746285 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ffwf9" podStartSLOduration=66.62092413 podStartE2EDuration="1m7.746268775s" totalImagesPullingTime="1.125344645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:40.745567215 +0000 UTC m=+68.904883562" watchObservedRunningTime="2026-07-24 12:38:40.746268775 +0000 UTC m=+68.905585116" Jul 24 12:38:41.111845 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:41.111806 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:41.246189 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:41.246158 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:41.714786 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:41.714752 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" event={"ID":"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df","Type":"ContainerStarted","Data":"46fd23da7ebafc95dae6cd9074059f6a481b0beb0e17cfdbbd66078c9adc42c1"} Jul 24 12:38:41.715293 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:41.714840 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" event={"ID":"28281cb5-b0f5-46cc-bdc1-4845cd5ac4df","Type":"ContainerStarted","Data":"8e663c4761354c5d45cb5895651be5b1296546db271d38423f86091730c9637b"} Jul 24 12:38:43.622499 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:43.622453 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:44.143584 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.143526 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-l4wz9" podStartSLOduration=4.369956726 podStartE2EDuration="6.143509556s" totalImagesPullingTime="1.77355283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:41.761610896 +0000 UTC m=+69.920927231" watchObservedRunningTime="2026-07-24 12:38:44.143509556 +0000 UTC m=+72.302825891" Jul 24 12:38:44.144386 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.144364 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-847z4"] Jul 24 12:38:44.166592 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.166568 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.175637 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.175617 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 12:38:44.182250 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.182235 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f5qgw\"" Jul 24 12:38:44.182953 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.182937 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 12:38:44.183129 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.183112 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 12:38:44.276334 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.276302 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed3578d2-6ac7-42fb-ad7c-eb675775a695-root\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.276334 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.276332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-tls\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.276557 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.276353 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-wtmp\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.276557 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.276409 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed3578d2-6ac7-42fb-ad7c-eb675775a695-metrics-client-ca\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.276557 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.276438 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-accelerators-collector-config\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.276557 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.276471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.276557 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.276489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpc9v\" (UniqueName: \"kubernetes.io/projected/ed3578d2-6ac7-42fb-ad7c-eb675775a695-kube-api-access-tpc9v\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.276557 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.276516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed3578d2-6ac7-42fb-ad7c-eb675775a695-sys\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.276771 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.276584 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-textfile\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.377866 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.377830 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed3578d2-6ac7-42fb-ad7c-eb675775a695-root\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.377866 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.377869 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-tls\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.377911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-wtmp\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.377935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed3578d2-6ac7-42fb-ad7c-eb675775a695-metrics-client-ca\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.377951 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed3578d2-6ac7-42fb-ad7c-eb675775a695-root\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.377954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-accelerators-collector-config\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.378010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.378052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpc9v\" (UniqueName: \"kubernetes.io/projected/ed3578d2-6ac7-42fb-ad7c-eb675775a695-kube-api-access-tpc9v\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.378058 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-wtmp\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.378075 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed3578d2-6ac7-42fb-ad7c-eb675775a695-sys\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.378105 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed3578d2-6ac7-42fb-ad7c-eb675775a695-sys\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378551 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.378123 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-textfile\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378551 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.378454 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-textfile\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378551 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.378540 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed3578d2-6ac7-42fb-ad7c-eb675775a695-metrics-client-ca\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.378687 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.378616 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-accelerators-collector-config\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.380495 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.380472 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.380647 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.380631 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed3578d2-6ac7-42fb-ad7c-eb675775a695-node-exporter-tls\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.391298 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.391276 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpc9v\" (UniqueName: \"kubernetes.io/projected/ed3578d2-6ac7-42fb-ad7c-eb675775a695-kube-api-access-tpc9v\") pod \"node-exporter-847z4\" (UID: \"ed3578d2-6ac7-42fb-ad7c-eb675775a695\") " pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.408807 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.408730 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:44.475578 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.475548 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-847z4" Jul 24 12:38:44.479512 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.479472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:44.484034 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.484008 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5d4b71-e854-457a-97b2-dbcbefabe000-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bl7v\" (UID: \"0f5d4b71-e854-457a-97b2-dbcbefabe000\") " pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:44.486920 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:44.486895 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3578d2_6ac7_42fb_ad7c_eb675775a695.slice/crio-e0649ff9213180915f9b1d0b757bd19e5cf8ca2cfbf49bd1f9395f26a827ccf5 WatchSource:0}: Error finding container e0649ff9213180915f9b1d0b757bd19e5cf8ca2cfbf49bd1f9395f26a827ccf5: Status 404 returned error can't find the container with id e0649ff9213180915f9b1d0b757bd19e5cf8ca2cfbf49bd1f9395f26a827ccf5 Jul 24 12:38:44.582536 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.582485 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:44.673359 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.673282 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pmfwn\"" Jul 24 12:38:44.678159 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.678136 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4bl7v" Jul 24 12:38:44.726843 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.726805 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6ndzc" event={"ID":"e20441fc-7657-433e-926c-6c8c707528e8","Type":"ContainerStarted","Data":"32ce205fe024f9f03d6cf23698efa229b5adb21176290afbd89e9a974e2b2551"} Jul 24 12:38:44.727035 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.726969 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:38:44.729945 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.728821 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49lt9" event={"ID":"68d749be-07e2-42c1-a702-6e5fef952f66","Type":"ContainerStarted","Data":"6bc66c950e8463f3d1485f3e34a48ce62f8da84a42f404607ef1920e68d3f79e"} Jul 24 12:38:44.731389 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.731268 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:44.731665 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.731622 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-847z4" event={"ID":"ed3578d2-6ac7-42fb-ad7c-eb675775a695","Type":"ContainerStarted","Data":"e0649ff9213180915f9b1d0b757bd19e5cf8ca2cfbf49bd1f9395f26a827ccf5"} Jul 24 12:38:44.762320 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.762149 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6ndzc" podStartSLOduration=67.573984635 podStartE2EDuration="1m12.762125508s" totalImagesPullingTime="5.188140873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:44.760554328 +0000 UTC m=+72.919870664" watchObservedRunningTime="2026-07-24 12:38:44.762125508 +0000 UTC m=+72.921441845" Jul 24 12:38:44.810535 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.810481 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-49lt9" podStartSLOduration=66.384404742 podStartE2EDuration="1m11.810464352s" totalImagesPullingTime="5.42605961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:44.808106208 +0000 UTC m=+72.967422544" watchObservedRunningTime="2026-07-24 12:38:44.810464352 +0000 UTC m=+72.969780724" Jul 24 12:38:44.846444 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:44.846412 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4bl7v"] Jul 24 12:38:44.849836 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:44.849801 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5d4b71_e854_457a_97b2_dbcbefabe000.slice/crio-ec8946b11035ac74d07e642d38c8c318af98a181acaec88a14462c40b5b387f6 WatchSource:0}: Error finding container ec8946b11035ac74d07e642d38c8c318af98a181acaec88a14462c40b5b387f6: Status 404 returned error can't find the container with id ec8946b11035ac74d07e642d38c8c318af98a181acaec88a14462c40b5b387f6 Jul 24 12:38:45.024293 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:45.024231 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:45.278476 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:45.278393 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:45.457125 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:45.457089 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:45.737997 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:45.737922 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bl7v" event={"ID":"0f5d4b71-e854-457a-97b2-dbcbefabe000","Type":"ContainerStarted","Data":"ec8946b11035ac74d07e642d38c8c318af98a181acaec88a14462c40b5b387f6"} Jul 24 12:38:46.056312 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:46.056271 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:46.179313 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:46.179275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:46.743129 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:46.743045 2560 generic.go:356] "Generic (PLEG): container finished" podID="ed3578d2-6ac7-42fb-ad7c-eb675775a695" containerID="13e9ef8a3bc1bae59752f777690e7f05a3545adc044fe96361ebb5541d444058" exitCode=0 Jul 24 12:38:46.743129 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:46.743125 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-847z4" event={"ID":"ed3578d2-6ac7-42fb-ad7c-eb675775a695","Type":"ContainerDied","Data":"13e9ef8a3bc1bae59752f777690e7f05a3545adc044fe96361ebb5541d444058"} Jul 24 12:38:47.043011 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:47.042974 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:47.176494 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:47.176466 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:47.381974 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:47.381869 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:47.750206 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:47.750119 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-847z4" event={"ID":"ed3578d2-6ac7-42fb-ad7c-eb675775a695","Type":"ContainerStarted","Data":"961a732e36ead7edaf0d0231be48ce85395dcd692e8b05a5ff2003a88da7b99f"} Jul 24 12:38:47.750206 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:47.750175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-847z4" event={"ID":"ed3578d2-6ac7-42fb-ad7c-eb675775a695","Type":"ContainerStarted","Data":"2009cde01ab8b692a6f84f70dc5bef2a1d3330176a877b63c370b4e10943dd7f"} Jul 24 12:38:47.791353 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:47.791285 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-847z4" podStartSLOduration=1.817613122 podStartE2EDuration="3.791263512s" totalImagesPullingTime="1.892955277s" totalInitContainerRuntime="80.695113ms" isStatefulPod=true podCreationTimestamp="2026-07-24 12:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:47.789380197 +0000 UTC m=+75.948696527" watchObservedRunningTime="2026-07-24 12:38:47.791263512 +0000 UTC m=+75.950579849" Jul 24 12:38:47.792350 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:47.792323 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:48.618575 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.618520 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:48.784417 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.783935 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64599f7bb8-lcz6n"] Jul 24 12:38:48.800794 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.800766 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:48.805291 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.805263 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 24 12:38:48.805905 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.805803 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 24 12:38:48.805905 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.805830 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-70uj1rhbb1jsu\"" Jul 24 12:38:48.805905 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.805900 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 12:38:48.806119 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.806100 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 24 12:38:48.806305 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.806181 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2dm4d\"" Jul 24 12:38:48.837412 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.837377 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64599f7bb8-lcz6n"] Jul 24 12:38:48.912061 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.911974 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f413c02-e856-4e04-bcfe-c0588eb831a2-secret-metrics-server-client-certs\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:48.912061 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.912011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f413c02-e856-4e04-bcfe-c0588eb831a2-metrics-server-audit-profiles\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:48.912061 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.912043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv65s\" (UniqueName: \"kubernetes.io/projected/5f413c02-e856-4e04-bcfe-c0588eb831a2-kube-api-access-kv65s\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:48.912275 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.912121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f413c02-e856-4e04-bcfe-c0588eb831a2-secret-metrics-server-tls\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:48.912275 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.912169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f413c02-e856-4e04-bcfe-c0588eb831a2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:48.912275 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.912193 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f413c02-e856-4e04-bcfe-c0588eb831a2-audit-log\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:48.912275 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:48.912215 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f413c02-e856-4e04-bcfe-c0588eb831a2-client-ca-bundle\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.013153 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.013104 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f413c02-e856-4e04-bcfe-c0588eb831a2-secret-metrics-server-client-certs\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.013153 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.013158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f413c02-e856-4e04-bcfe-c0588eb831a2-metrics-server-audit-profiles\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.013381 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.013187 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv65s\" (UniqueName: \"kubernetes.io/projected/5f413c02-e856-4e04-bcfe-c0588eb831a2-kube-api-access-kv65s\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.013381 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.013215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f413c02-e856-4e04-bcfe-c0588eb831a2-secret-metrics-server-tls\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.013381 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.013258 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f413c02-e856-4e04-bcfe-c0588eb831a2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.013381 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.013290 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f413c02-e856-4e04-bcfe-c0588eb831a2-audit-log\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.013381 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.013317 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f413c02-e856-4e04-bcfe-c0588eb831a2-client-ca-bundle\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.014061 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.014017 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f413c02-e856-4e04-bcfe-c0588eb831a2-audit-log\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.014212 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.014185 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f413c02-e856-4e04-bcfe-c0588eb831a2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.014296 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.014277 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f413c02-e856-4e04-bcfe-c0588eb831a2-metrics-server-audit-profiles\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.016303 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.016282 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f413c02-e856-4e04-bcfe-c0588eb831a2-secret-metrics-server-client-certs\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.016553 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.016531 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f413c02-e856-4e04-bcfe-c0588eb831a2-client-ca-bundle\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.017064 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.017040 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f413c02-e856-4e04-bcfe-c0588eb831a2-secret-metrics-server-tls\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.027024 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.027003 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv65s\" (UniqueName: \"kubernetes.io/projected/5f413c02-e856-4e04-bcfe-c0588eb831a2-kube-api-access-kv65s\") pod \"metrics-server-64599f7bb8-lcz6n\" (UID: \"5f413c02-e856-4e04-bcfe-c0588eb831a2\") " pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.112025 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.111986 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:38:49.455636 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.455598 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:49.464697 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.464667 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-f989ff447-gv6z9"] Jul 24 12:38:49.468047 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.468025 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.477898 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.477859 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 12:38:49.478019 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.477937 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 12:38:49.478019 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.477995 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 12:38:49.478134 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.478015 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4ck8j\"" Jul 24 12:38:49.478185 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.478132 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 12:38:49.478466 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.478448 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 12:38:49.489835 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.489815 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 12:38:49.500399 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.500375 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f989ff447-gv6z9"] Jul 24 12:38:49.516185 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.516159 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-secret-telemeter-client\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.516321 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.516206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-telemeter-client-tls\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.516321 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.516234 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b53aaad3-a378-4216-8da4-cfbdb9426d5b-metrics-client-ca\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.516321 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.516262 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53aaad3-a378-4216-8da4-cfbdb9426d5b-serving-certs-ca-bundle\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.516321 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.516302 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-federate-client-tls\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.516530 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.516356 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.516530 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.516401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53aaad3-a378-4216-8da4-cfbdb9426d5b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.516530 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.516472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlwps\" (UniqueName: \"kubernetes.io/projected/b53aaad3-a378-4216-8da4-cfbdb9426d5b-kube-api-access-xlwps\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.617412 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.617373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-secret-telemeter-client\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.617569 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.617459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-telemeter-client-tls\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.617569 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.617488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b53aaad3-a378-4216-8da4-cfbdb9426d5b-metrics-client-ca\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.617569 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.617518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53aaad3-a378-4216-8da4-cfbdb9426d5b-serving-certs-ca-bundle\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.617569 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.617554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-federate-client-tls\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.617768 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.617579 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.617768 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.617604 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53aaad3-a378-4216-8da4-cfbdb9426d5b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.617768 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.617637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlwps\" (UniqueName: \"kubernetes.io/projected/b53aaad3-a378-4216-8da4-cfbdb9426d5b-kube-api-access-xlwps\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.618287 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.618257 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b53aaad3-a378-4216-8da4-cfbdb9426d5b-metrics-client-ca\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.618586 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.618486 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53aaad3-a378-4216-8da4-cfbdb9426d5b-serving-certs-ca-bundle\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.619002 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.618962 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53aaad3-a378-4216-8da4-cfbdb9426d5b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.620666 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.620649 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-telemeter-client-tls\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.620731 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.620665 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-secret-telemeter-client\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.620862 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.620848 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-federate-client-tls\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.622458 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.622435 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b53aaad3-a378-4216-8da4-cfbdb9426d5b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.652647 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.652615 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlwps\" (UniqueName: \"kubernetes.io/projected/b53aaad3-a378-4216-8da4-cfbdb9426d5b-kube-api-access-xlwps\") pod \"telemeter-client-f989ff447-gv6z9\" (UID: \"b53aaad3-a378-4216-8da4-cfbdb9426d5b\") " pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:49.778159 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:49.778125 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" Jul 24 12:38:50.267804 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:50.267734 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64599f7bb8-lcz6n"] Jul 24 12:38:50.272555 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:50.272516 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f413c02_e856_4e04_bcfe_c0588eb831a2.slice/crio-3b9fca4fa7f266a28755eb7746345391b7fff5dd058329f82a915def51fcd2ae WatchSource:0}: Error finding container 3b9fca4fa7f266a28755eb7746345391b7fff5dd058329f82a915def51fcd2ae: Status 404 returned error can't find the container with id 3b9fca4fa7f266a28755eb7746345391b7fff5dd058329f82a915def51fcd2ae Jul 24 12:38:50.280599 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:50.280575 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f989ff447-gv6z9"] Jul 24 12:38:50.282608 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:50.282584 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb53aaad3_a378_4216_8da4_cfbdb9426d5b.slice/crio-42fc97cdf5cf7bd6b6e113a474f6005db19fba1ef7bb27de214667495edfc099 WatchSource:0}: Error finding container 42fc97cdf5cf7bd6b6e113a474f6005db19fba1ef7bb27de214667495edfc099: Status 404 returned error can't find the container with id 42fc97cdf5cf7bd6b6e113a474f6005db19fba1ef7bb27de214667495edfc099 Jul 24 12:38:50.379826 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:50.379748 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:50.762277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:50.762184 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" event={"ID":"5f413c02-e856-4e04-bcfe-c0588eb831a2","Type":"ContainerStarted","Data":"3b9fca4fa7f266a28755eb7746345391b7fff5dd058329f82a915def51fcd2ae"} Jul 24 12:38:50.764293 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:50.764218 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" event={"ID":"b53aaad3-a378-4216-8da4-cfbdb9426d5b","Type":"ContainerStarted","Data":"42fc97cdf5cf7bd6b6e113a474f6005db19fba1ef7bb27de214667495edfc099"} Jul 24 12:38:50.766173 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:50.766134 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bl7v" event={"ID":"0f5d4b71-e854-457a-97b2-dbcbefabe000","Type":"ContainerStarted","Data":"9daff4651b337748f81a4c614b3139be58eb5ecc6f515d99b637d545c73eb705"} Jul 24 12:38:50.797376 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:50.797300 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:51.005151 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.005102 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:51.361729 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.361695 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-76w6r"] Jul 24 12:38:51.364820 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.364122 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-76w6r" Jul 24 12:38:51.369024 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.368999 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 12:38:51.369144 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.369110 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hcdlw\"" Jul 24 12:38:51.369210 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.369004 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 12:38:51.384629 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.384568 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-76w6r"] Jul 24 12:38:51.420637 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.420595 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:51.433918 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.433864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75s4m\" (UniqueName: \"kubernetes.io/projected/86fc48b9-c493-4c64-8204-8efa1fec0d94-kube-api-access-75s4m\") pod \"downloads-7c97dc4555-76w6r\" (UID: \"86fc48b9-c493-4c64-8204-8efa1fec0d94\") " pod="openshift-console/downloads-7c97dc4555-76w6r" Jul 24 12:38:51.534920 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.534762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75s4m\" (UniqueName: \"kubernetes.io/projected/86fc48b9-c493-4c64-8204-8efa1fec0d94-kube-api-access-75s4m\") pod \"downloads-7c97dc4555-76w6r\" (UID: \"86fc48b9-c493-4c64-8204-8efa1fec0d94\") " pod="openshift-console/downloads-7c97dc4555-76w6r" Jul 24 12:38:51.558942 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.558868 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75s4m\" (UniqueName: \"kubernetes.io/projected/86fc48b9-c493-4c64-8204-8efa1fec0d94-kube-api-access-75s4m\") pod \"downloads-7c97dc4555-76w6r\" (UID: \"86fc48b9-c493-4c64-8204-8efa1fec0d94\") " pod="openshift-console/downloads-7c97dc4555-76w6r" Jul 24 12:38:51.560083 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.559863 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:51.656510 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.656412 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:51.679233 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.679198 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-76w6r" Jul 24 12:38:51.780063 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.780031 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:51.965442 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:51.965364 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:52.091025 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:52.090981 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:52.428611 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:52.428576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:52.880931 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:52.880898 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:53.047997 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:53.047960 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:53.442742 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:53.442705 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:53.778925 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:53.778868 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:53.998133 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:53.998095 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:54.645633 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:54.645605 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-76w6r"] Jul 24 12:38:54.649010 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:38:54.648981 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fc48b9_c493_4c64_8204_8efa1fec0d94.slice/crio-49b6dee91056311400a2a91b0a91a4565de15b05dc9e6258cc2050cd49348aed WatchSource:0}: Error finding container 49b6dee91056311400a2a91b0a91a4565de15b05dc9e6258cc2050cd49348aed: Status 404 returned error can't find the container with id 49b6dee91056311400a2a91b0a91a4565de15b05dc9e6258cc2050cd49348aed Jul 24 12:38:54.788276 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:54.788246 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" event={"ID":"b53aaad3-a378-4216-8da4-cfbdb9426d5b","Type":"ContainerStarted","Data":"44c2b16d1c43675cfc97fc9a29bc1f4606dcfecb7fb8a4ec40cb5c9ba5976cec"} Jul 24 12:38:54.790029 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:54.790003 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bl7v" event={"ID":"0f5d4b71-e854-457a-97b2-dbcbefabe000","Type":"ContainerStarted","Data":"4283305fe9de658fa6a7f94a7272820df9e2581b72f6d6eca02c77d1ec61496a"} Jul 24 12:38:54.791411 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:54.791387 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" event={"ID":"5f413c02-e856-4e04-bcfe-c0588eb831a2","Type":"ContainerStarted","Data":"bd57f2692977ca4fc480e60798543a99f4a2112637bd8b87510d0ce998400445"} Jul 24 12:38:54.792620 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:54.792600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-76w6r" event={"ID":"86fc48b9-c493-4c64-8204-8efa1fec0d94","Type":"ContainerStarted","Data":"49b6dee91056311400a2a91b0a91a4565de15b05dc9e6258cc2050cd49348aed"} Jul 24 12:38:54.837637 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:54.837582 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" podStartSLOduration=2.639922105 podStartE2EDuration="6.837561867s" totalImagesPullingTime="4.197639762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:54.836636577 +0000 UTC m=+82.995952913" watchObservedRunningTime="2026-07-24 12:38:54.837561867 +0000 UTC m=+82.996878204" Jul 24 12:38:55.037044 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:55.036958 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:55.269214 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:55.269009 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:56.806991 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:56.806950 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" event={"ID":"b53aaad3-a378-4216-8da4-cfbdb9426d5b","Type":"ContainerStarted","Data":"e9cd3b83df92c1fec3a706bc28db17cbb31c4079de55a2529b79e495bc01f9e9"} Jul 24 12:38:56.807374 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:56.807027 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" event={"ID":"b53aaad3-a378-4216-8da4-cfbdb9426d5b","Type":"ContainerStarted","Data":"3a6691e1706342f4869078e7f6658e0888a5ed2c772fb4e6168e184c2be109c1"} Jul 24 12:38:58.689859 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:58.689822 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-567b79bcb-4tsr6" Jul 24 12:38:58.725727 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:58.725400 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-f989ff447-gv6z9" podStartSLOduration=4.223122075 podStartE2EDuration="9.725377954s" totalImagesPullingTime="5.502255879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:38:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:56.848657234 +0000 UTC m=+85.007973569" watchObservedRunningTime="2026-07-24 12:38:58.725377954 +0000 UTC m=+86.884694290" Jul 24 12:38:59.051606 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:59.051578 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:59.152164 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:59.152123 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:59.292141 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:59.292097 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:59.387636 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:59.387599 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:38:59.821894 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:59.821846 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bl7v" event={"ID":"0f5d4b71-e854-457a-97b2-dbcbefabe000","Type":"ContainerStarted","Data":"d58788a7386d45cb29addaf09685aa966b3d59aff9005d01df5bef1116e68bef"} Jul 24 12:38:59.864109 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:38:59.864060 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4bl7v" podStartSLOduration=33.918633346 podStartE2EDuration="47.864042486s" totalImagesPullingTime="13.94540914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:38:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:38:59.863714387 +0000 UTC m=+88.023030723" watchObservedRunningTime="2026-07-24 12:38:59.864042486 +0000 UTC m=+88.023358822" Jul 24 12:39:01.004721 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.004686 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:01.210380 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.210295 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:01.211075 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.211053 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dbb766c5-sgrmv"] Jul 24 12:39:01.215584 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.215565 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.222061 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.222038 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 12:39:01.222191 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.222079 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 12:39:01.222191 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.222119 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wz2fm\"" Jul 24 12:39:01.222302 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.222251 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 12:39:01.222302 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.222269 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 12:39:01.222606 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.222588 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 12:39:01.247101 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.247070 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbb766c5-sgrmv"] Jul 24 12:39:01.328158 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.328121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-console-config\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.328356 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.328174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-service-ca\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.328356 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.328217 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66nmj\" (UniqueName: \"kubernetes.io/projected/9b9eadf7-cc11-4806-813f-f20538c60436-kube-api-access-66nmj\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.328356 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.328280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-oauth-serving-cert\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.328356 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.328351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-oauth-config\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.328547 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.328382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-serving-cert\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.429488 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.429456 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-service-ca\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.429664 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.429497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66nmj\" (UniqueName: \"kubernetes.io/projected/9b9eadf7-cc11-4806-813f-f20538c60436-kube-api-access-66nmj\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.429664 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.429527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-oauth-serving-cert\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.429664 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.429579 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-oauth-config\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.429664 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.429606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-serving-cert\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.429664 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.429638 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-console-config\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.430404 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.430340 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-service-ca\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.430404 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.430352 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-oauth-serving-cert\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.430404 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.430385 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-console-config\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.432335 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.432313 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-oauth-config\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.432482 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.432459 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-serving-cert\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.446063 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.446037 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66nmj\" (UniqueName: \"kubernetes.io/projected/9b9eadf7-cc11-4806-813f-f20538c60436-kube-api-access-66nmj\") pod \"console-6dbb766c5-sgrmv\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.526469 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.526436 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:01.644848 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.644819 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:01.688172 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.688148 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbb766c5-sgrmv"] Jul 24 12:39:01.690719 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:39:01.690693 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9eadf7_cc11_4806_813f_f20538c60436.slice/crio-d42f6c35563af66dffb6cc73a59ca6a539b437b57fbed160b515b149cca66ba6 WatchSource:0}: Error finding container d42f6c35563af66dffb6cc73a59ca6a539b437b57fbed160b515b149cca66ba6: Status 404 returned error can't find the container with id d42f6c35563af66dffb6cc73a59ca6a539b437b57fbed160b515b149cca66ba6 Jul 24 12:39:01.831930 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:01.831892 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbb766c5-sgrmv" event={"ID":"9b9eadf7-cc11-4806-813f-f20538c60436","Type":"ContainerStarted","Data":"d42f6c35563af66dffb6cc73a59ca6a539b437b57fbed160b515b149cca66ba6"} Jul 24 12:39:02.359904 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:02.359807 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:04.284067 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:04.284020 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:04.425351 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:04.425232 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:05.242399 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.242368 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:05.403575 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.403540 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:05.474244 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.474204 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d47ccf646-zxhm8"] Jul 24 12:39:05.477580 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.477560 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.493643 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.493566 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 12:39:05.514284 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.514254 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d47ccf646-zxhm8"] Jul 24 12:39:05.561570 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.561530 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:05.565381 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.565351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-oauth-serving-cert\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.565521 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.565388 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-trusted-ca-bundle\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.565521 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.565461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-oauth-config\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.565521 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.565501 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-serving-cert\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.565654 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.565525 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-console-config\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.565654 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.565574 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-service-ca\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.565654 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.565606 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm5bd\" (UniqueName: \"kubernetes.io/projected/02e3d022-cf60-4388-aaea-46ec2f859896-kube-api-access-tm5bd\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.666764 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.666725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-service-ca\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.666977 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.666774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm5bd\" (UniqueName: \"kubernetes.io/projected/02e3d022-cf60-4388-aaea-46ec2f859896-kube-api-access-tm5bd\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.666977 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.666840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-oauth-serving-cert\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.666977 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.666865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-trusted-ca-bundle\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.666977 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.666928 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-oauth-config\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.666977 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.666957 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-serving-cert\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.667255 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.666984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-console-config\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.667661 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.667622 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-service-ca\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.667661 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.667653 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-console-config\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.667838 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.667713 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-oauth-serving-cert\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.667838 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.667821 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-trusted-ca-bundle\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.669689 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.669660 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-oauth-config\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.669840 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.669818 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-serving-cert\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.679316 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.679289 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm5bd\" (UniqueName: \"kubernetes.io/projected/02e3d022-cf60-4388-aaea-46ec2f859896-kube-api-access-tm5bd\") pod \"console-6d47ccf646-zxhm8\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:05.789423 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:05.789383 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:09.112896 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:09.112836 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:39:09.113379 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:09.112935 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:39:11.304137 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:11.304090 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:11.407567 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:11.407516 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:12.871396 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:12.871351 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:12.973523 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:12.973490 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d47ccf646-zxhm8"] Jul 24 12:39:12.976736 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:39:12.976709 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e3d022_cf60_4388_aaea_46ec2f859896.slice/crio-b49d76c5e891929132a9473b85540507433c125df19f10e40ef1ac631bddc23f WatchSource:0}: Error finding container b49d76c5e891929132a9473b85540507433c125df19f10e40ef1ac631bddc23f: Status 404 returned error can't find the container with id b49d76c5e891929132a9473b85540507433c125df19f10e40ef1ac631bddc23f Jul 24 12:39:13.889226 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:13.889169 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-76w6r" event={"ID":"86fc48b9-c493-4c64-8204-8efa1fec0d94","Type":"ContainerStarted","Data":"8a3271c617143e49b60dde74a8c3712d95afb500cec9eb3d88a59a452d867c6a"} Jul 24 12:39:13.889707 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:13.889242 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-76w6r" Jul 24 12:39:13.891550 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:13.891121 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbb766c5-sgrmv" event={"ID":"9b9eadf7-cc11-4806-813f-f20538c60436","Type":"ContainerStarted","Data":"253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2"} Jul 24 12:39:13.893237 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:13.893161 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d47ccf646-zxhm8" event={"ID":"02e3d022-cf60-4388-aaea-46ec2f859896","Type":"ContainerStarted","Data":"11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23"} Jul 24 12:39:13.893237 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:13.893212 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d47ccf646-zxhm8" event={"ID":"02e3d022-cf60-4388-aaea-46ec2f859896","Type":"ContainerStarted","Data":"b49d76c5e891929132a9473b85540507433c125df19f10e40ef1ac631bddc23f"} Jul 24 12:39:13.905224 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:13.905198 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-76w6r" Jul 24 12:39:13.953513 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:13.953458 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-76w6r" podStartSLOduration=4.715379163 podStartE2EDuration="22.953440378s" totalImagesPullingTime="18.238061215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:39:13.920307912 +0000 UTC m=+102.079624250" watchObservedRunningTime="2026-07-24 12:39:13.953440378 +0000 UTC m=+102.112756714" Jul 24 12:39:13.983565 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:13.983490 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d47ccf646-zxhm8" podStartSLOduration=8.983469636 podStartE2EDuration="8.983469636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:39:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:39:13.980488599 +0000 UTC m=+102.139804983" watchObservedRunningTime="2026-07-24 12:39:13.983469636 +0000 UTC m=+102.142785973" Jul 24 12:39:14.008085 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:14.008026 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dbb766c5-sgrmv" podStartSLOduration=1.882670987 podStartE2EDuration="13.008003788s" totalImagesPullingTime="11.125332801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:39:14.005370507 +0000 UTC m=+102.164686856" watchObservedRunningTime="2026-07-24 12:39:14.008003788 +0000 UTC m=+102.167320125" Jul 24 12:39:15.741581 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:15.741545 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6ndzc" Jul 24 12:39:15.789956 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:15.789923 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:15.790486 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:15.790195 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:15.796321 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:15.796294 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:15.907206 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:15.907173 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:39:15.971251 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:15.971209 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbb766c5-sgrmv"] Jul 24 12:39:17.793436 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:17.793384 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:17.895487 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:17.895456 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:18.600722 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:18.600690 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:18.718633 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:18.718603 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:21.526953 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:21.526904 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:23.146031 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:23.145996 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-48scl_dc26c320-d6f6-490a-aa8a-f1bc610fc9ea/serve-healthcheck-canary/0.log" Jul 24 12:39:26.284018 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:26.283978 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:26.352412 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:26.352377 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:29.117700 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:29.117668 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:39:29.121571 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:29.121547 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64599f7bb8-lcz6n" Jul 24 12:39:29.396091 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:29.396000 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:29.495100 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:29.495063 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:34.467044 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:34.466993 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:34.566827 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:34.566791 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:34.770575 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:34.770503 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:40.998992 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:40.998945 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dbb766c5-sgrmv" podUID="9b9eadf7-cc11-4806-813f-f20538c60436" containerName="console" containerID="cri-o://253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2" gracePeriod=15 Jul 24 12:39:41.274734 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.274708 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:41.306302 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.306271 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:41.362376 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.362344 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66nmj\" (UniqueName: \"kubernetes.io/projected/9b9eadf7-cc11-4806-813f-f20538c60436-kube-api-access-66nmj\") pod \"9b9eadf7-cc11-4806-813f-f20538c60436\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " Jul 24 12:39:41.362547 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.362391 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-oauth-config\") pod \"9b9eadf7-cc11-4806-813f-f20538c60436\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " Jul 24 12:39:41.362547 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.362415 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-oauth-serving-cert\") pod \"9b9eadf7-cc11-4806-813f-f20538c60436\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " Jul 24 12:39:41.362547 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.362439 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-console-config\") pod \"9b9eadf7-cc11-4806-813f-f20538c60436\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " Jul 24 12:39:41.362547 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.362483 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-service-ca\") pod \"9b9eadf7-cc11-4806-813f-f20538c60436\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " Jul 24 12:39:41.362547 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.362519 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-serving-cert\") pod \"9b9eadf7-cc11-4806-813f-f20538c60436\" (UID: \"9b9eadf7-cc11-4806-813f-f20538c60436\") " Jul 24 12:39:41.362997 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.362961 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9b9eadf7-cc11-4806-813f-f20538c60436" (UID: "9b9eadf7-cc11-4806-813f-f20538c60436"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:39:41.362997 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.362978 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-service-ca" (OuterVolumeSpecName: "service-ca") pod "9b9eadf7-cc11-4806-813f-f20538c60436" (UID: "9b9eadf7-cc11-4806-813f-f20538c60436"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:39:41.363361 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.362965 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-console-config" (OuterVolumeSpecName: "console-config") pod "9b9eadf7-cc11-4806-813f-f20538c60436" (UID: "9b9eadf7-cc11-4806-813f-f20538c60436"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:39:41.364851 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.364827 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9b9eadf7-cc11-4806-813f-f20538c60436" (UID: "9b9eadf7-cc11-4806-813f-f20538c60436"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:39:41.364851 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.364835 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b9eadf7-cc11-4806-813f-f20538c60436-kube-api-access-66nmj" (OuterVolumeSpecName: "kube-api-access-66nmj") pod "9b9eadf7-cc11-4806-813f-f20538c60436" (UID: "9b9eadf7-cc11-4806-813f-f20538c60436"). InnerVolumeSpecName "kube-api-access-66nmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:39:41.364851 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.364847 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9b9eadf7-cc11-4806-813f-f20538c60436" (UID: "9b9eadf7-cc11-4806-813f-f20538c60436"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:39:41.392329 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.392295 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:39:41.464101 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.464069 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:39:41.464101 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.464095 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:39:41.464101 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.464105 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66nmj\" (UniqueName: \"kubernetes.io/projected/9b9eadf7-cc11-4806-813f-f20538c60436-kube-api-access-66nmj\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:39:41.464340 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.464138 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b9eadf7-cc11-4806-813f-f20538c60436-console-oauth-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:39:41.464340 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.464147 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-oauth-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:39:41.464340 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:41.464156 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b9eadf7-cc11-4806-813f-f20538c60436-console-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:39:42.007619 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.007577 2560 generic.go:356] "Generic (PLEG): container finished" podID="9b9eadf7-cc11-4806-813f-f20538c60436" containerID="253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2" exitCode=0 Jul 24 12:39:42.008039 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.007639 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbb766c5-sgrmv" Jul 24 12:39:42.008039 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.007678 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbb766c5-sgrmv" event={"ID":"9b9eadf7-cc11-4806-813f-f20538c60436","Type":"ContainerDied","Data":"253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2"} Jul 24 12:39:42.008039 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.007735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbb766c5-sgrmv" event={"ID":"9b9eadf7-cc11-4806-813f-f20538c60436","Type":"ContainerDied","Data":"d42f6c35563af66dffb6cc73a59ca6a539b437b57fbed160b515b149cca66ba6"} Jul 24 12:39:42.008039 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.007767 2560 scope.go:117] "RemoveContainer" containerID="253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2" Jul 24 12:39:42.016545 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.016529 2560 scope.go:117] "RemoveContainer" containerID="253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2" Jul 24 12:39:42.016824 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:39:42.016802 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2\": container with ID starting with 253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2 not found: ID does not exist" containerID="253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2" Jul 24 12:39:42.016919 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.016831 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2"} err="failed to get container status \"253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2\": rpc error: code = NotFound desc = could not find container \"253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2\": container with ID starting with 253529b8d71455ca70e41c28429f9a011a121e02e8eec6c319e78b3164869da2 not found: ID does not exist" Jul 24 12:39:42.033741 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.033711 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbb766c5-sgrmv"] Jul 24 12:39:42.037642 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.037621 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dbb766c5-sgrmv"] Jul 24 12:39:42.370949 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:39:42.370919 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b9eadf7-cc11-4806-813f-f20538c60436" path="/var/lib/kubelet/pods/9b9eadf7-cc11-4806-813f-f20538c60436/volumes" Jul 24 12:40:00.715767 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:00.715734 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:00.814112 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:00.814062 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:02.421282 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.421241 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fd8cd464d-cqrjp"] Jul 24 12:40:02.421651 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.421531 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b9eadf7-cc11-4806-813f-f20538c60436" containerName="console" Jul 24 12:40:02.421651 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.421543 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b9eadf7-cc11-4806-813f-f20538c60436" containerName="console" Jul 24 12:40:02.421651 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.421591 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b9eadf7-cc11-4806-813f-f20538c60436" containerName="console" Jul 24 12:40:02.424008 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.423992 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.439939 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.439904 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd8cd464d-cqrjp"] Jul 24 12:40:02.466517 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.466489 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:02.528701 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.528665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-trusted-ca-bundle\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.528701 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.528708 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-oauth-serving-cert\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.528914 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.528772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-serving-cert\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.528914 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.528806 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-oauth-config\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.528914 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.528867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-config\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.529015 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.528933 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5vc7\" (UniqueName: \"kubernetes.io/projected/c7fa1472-9c18-4af2-8796-ff4369a43f26-kube-api-access-g5vc7\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.529015 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.528954 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-service-ca\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.629584 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.629547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-oauth-serving-cert\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.629766 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.629601 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-serving-cert\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.629766 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.629619 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-oauth-config\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.629766 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.629647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-config\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.629766 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.629676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5vc7\" (UniqueName: \"kubernetes.io/projected/c7fa1472-9c18-4af2-8796-ff4369a43f26-kube-api-access-g5vc7\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.629766 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.629698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-service-ca\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.629766 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.629715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-trusted-ca-bundle\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.630461 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.630435 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-oauth-serving-cert\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.630568 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.630461 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-service-ca\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.630568 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.630520 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-config\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.630568 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.630523 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-trusted-ca-bundle\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.632967 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.632942 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-oauth-config\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.633061 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.633046 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-serving-cert\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.640828 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.640809 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5vc7\" (UniqueName: \"kubernetes.io/projected/c7fa1472-9c18-4af2-8796-ff4369a43f26-kube-api-access-g5vc7\") pod \"console-7fd8cd464d-cqrjp\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.732986 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.732905 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:02.868898 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:02.868853 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd8cd464d-cqrjp"] Jul 24 12:40:02.871218 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:40:02.871190 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7fa1472_9c18_4af2_8796_ff4369a43f26.slice/crio-d0d22d4a9d1334102494b7d2d185e93126ce76c9053374f1af79c475d083d5eb WatchSource:0}: Error finding container d0d22d4a9d1334102494b7d2d185e93126ce76c9053374f1af79c475d083d5eb: Status 404 returned error can't find the container with id d0d22d4a9d1334102494b7d2d185e93126ce76c9053374f1af79c475d083d5eb Jul 24 12:40:03.025752 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:03.025720 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:03.085614 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:03.085582 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd8cd464d-cqrjp" event={"ID":"c7fa1472-9c18-4af2-8796-ff4369a43f26","Type":"ContainerStarted","Data":"d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c"} Jul 24 12:40:03.085773 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:03.085632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd8cd464d-cqrjp" event={"ID":"c7fa1472-9c18-4af2-8796-ff4369a43f26","Type":"ContainerStarted","Data":"d0d22d4a9d1334102494b7d2d185e93126ce76c9053374f1af79c475d083d5eb"} Jul 24 12:40:03.113134 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:03.113079 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fd8cd464d-cqrjp" podStartSLOduration=1.113058437 podStartE2EDuration="1.113058437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:40:03.111349003 +0000 UTC m=+151.270665338" watchObservedRunningTime="2026-07-24 12:40:03.113058437 +0000 UTC m=+151.272374774" Jul 24 12:40:12.733771 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:12.733729 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:12.734220 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:12.733797 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:12.738547 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:12.738528 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:13.123618 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:13.123588 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:40:13.200307 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:13.200275 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d47ccf646-zxhm8"] Jul 24 12:40:13.447789 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:13.447700 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:13.569096 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:13.569060 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:16.772076 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:16.772039 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:16.865235 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:16.865197 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:26.310921 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:26.310811 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:26.410107 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:26.410051 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:35.200571 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:35.200536 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:38.219205 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.219146 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d47ccf646-zxhm8" podUID="02e3d022-cf60-4388-aaea-46ec2f859896" containerName="console" containerID="cri-o://11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23" gracePeriod=15 Jul 24 12:40:38.459053 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.459024 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:40:38.518768 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.518673 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-oauth-serving-cert\") pod \"02e3d022-cf60-4388-aaea-46ec2f859896\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " Jul 24 12:40:38.518768 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.518717 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-serving-cert\") pod \"02e3d022-cf60-4388-aaea-46ec2f859896\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " Jul 24 12:40:38.518768 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.518750 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-trusted-ca-bundle\") pod \"02e3d022-cf60-4388-aaea-46ec2f859896\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " Jul 24 12:40:38.518768 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.518766 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-oauth-config\") pod \"02e3d022-cf60-4388-aaea-46ec2f859896\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " Jul 24 12:40:38.519122 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.518791 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-console-config\") pod \"02e3d022-cf60-4388-aaea-46ec2f859896\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " Jul 24 12:40:38.519122 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.518819 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm5bd\" (UniqueName: \"kubernetes.io/projected/02e3d022-cf60-4388-aaea-46ec2f859896-kube-api-access-tm5bd\") pod \"02e3d022-cf60-4388-aaea-46ec2f859896\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " Jul 24 12:40:38.519122 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.518902 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-service-ca\") pod \"02e3d022-cf60-4388-aaea-46ec2f859896\" (UID: \"02e3d022-cf60-4388-aaea-46ec2f859896\") " Jul 24 12:40:38.519273 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.519247 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02e3d022-cf60-4388-aaea-46ec2f859896" (UID: "02e3d022-cf60-4388-aaea-46ec2f859896"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:40:38.519328 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.519297 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-console-config" (OuterVolumeSpecName: "console-config") pod "02e3d022-cf60-4388-aaea-46ec2f859896" (UID: "02e3d022-cf60-4388-aaea-46ec2f859896"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:40:38.519390 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.519334 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "02e3d022-cf60-4388-aaea-46ec2f859896" (UID: "02e3d022-cf60-4388-aaea-46ec2f859896"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:40:38.519390 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.519371 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-service-ca" (OuterVolumeSpecName: "service-ca") pod "02e3d022-cf60-4388-aaea-46ec2f859896" (UID: "02e3d022-cf60-4388-aaea-46ec2f859896"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:40:38.521246 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.521224 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e3d022-cf60-4388-aaea-46ec2f859896-kube-api-access-tm5bd" (OuterVolumeSpecName: "kube-api-access-tm5bd") pod "02e3d022-cf60-4388-aaea-46ec2f859896" (UID: "02e3d022-cf60-4388-aaea-46ec2f859896"). InnerVolumeSpecName "kube-api-access-tm5bd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:40:38.521505 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.521481 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02e3d022-cf60-4388-aaea-46ec2f859896" (UID: "02e3d022-cf60-4388-aaea-46ec2f859896"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:40:38.521568 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.521501 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02e3d022-cf60-4388-aaea-46ec2f859896" (UID: "02e3d022-cf60-4388-aaea-46ec2f859896"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:40:38.620056 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.620019 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-trusted-ca-bundle\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:40:38.620056 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.620049 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-oauth-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:40:38.620056 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.620059 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-console-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:40:38.620283 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.620068 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm5bd\" (UniqueName: \"kubernetes.io/projected/02e3d022-cf60-4388-aaea-46ec2f859896-kube-api-access-tm5bd\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:40:38.620283 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.620077 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:40:38.620283 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.620085 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3d022-cf60-4388-aaea-46ec2f859896-oauth-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:40:38.620283 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:38.620093 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3d022-cf60-4388-aaea-46ec2f859896-console-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:40:39.212670 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:39.212630 2560 generic.go:356] "Generic (PLEG): container finished" podID="02e3d022-cf60-4388-aaea-46ec2f859896" containerID="11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23" exitCode=0 Jul 24 12:40:39.212843 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:39.212686 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d47ccf646-zxhm8" Jul 24 12:40:39.212843 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:39.212723 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d47ccf646-zxhm8" event={"ID":"02e3d022-cf60-4388-aaea-46ec2f859896","Type":"ContainerDied","Data":"11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23"} Jul 24 12:40:39.212843 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:39.212790 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d47ccf646-zxhm8" event={"ID":"02e3d022-cf60-4388-aaea-46ec2f859896","Type":"ContainerDied","Data":"b49d76c5e891929132a9473b85540507433c125df19f10e40ef1ac631bddc23f"} Jul 24 12:40:39.212843 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:39.212813 2560 scope.go:117] "RemoveContainer" containerID="11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23" Jul 24 12:40:39.222642 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:39.222438 2560 scope.go:117] "RemoveContainer" containerID="11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23" Jul 24 12:40:39.223206 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:40:39.222773 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23\": container with ID starting with 11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23 not found: ID does not exist" containerID="11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23" Jul 24 12:40:39.223206 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:39.222802 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23"} err="failed to get container status \"11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23\": rpc error: code = NotFound desc = could not find container \"11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23\": container with ID starting with 11acfd98fa31f5440d5463a6b3ce66fd1675d6366d9982b098f8f2c06e8b4f23 not found: ID does not exist" Jul 24 12:40:39.245029 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:39.245002 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d47ccf646-zxhm8"] Jul 24 12:40:39.248816 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:39.248793 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d47ccf646-zxhm8"] Jul 24 12:40:40.368930 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:40.368896 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e3d022-cf60-4388-aaea-46ec2f859896" path="/var/lib/kubelet/pods/02e3d022-cf60-4388-aaea-46ec2f859896/volumes" Jul 24 12:40:53.341646 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:53.341610 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:40:53.404617 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:40:53.404584 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:01.968857 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:01.968813 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:02.068127 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:02.068085 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:05.441590 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:05.441552 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:05.534087 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:05.534043 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:08.599574 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.599542 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69"] Jul 24 12:41:08.599996 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.599802 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e3d022-cf60-4388-aaea-46ec2f859896" containerName="console" Jul 24 12:41:08.599996 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.599814 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e3d022-cf60-4388-aaea-46ec2f859896" containerName="console" Jul 24 12:41:08.599996 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.599869 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e3d022-cf60-4388-aaea-46ec2f859896" containerName="console" Jul 24 12:41:08.601907 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.601892 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.604450 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.604426 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 12:41:08.604450 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.604439 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 12:41:08.605441 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.605428 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cxdcp\"" Jul 24 12:41:08.614228 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.614203 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69"] Jul 24 12:41:08.636363 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.636328 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg8fg\" (UniqueName: \"kubernetes.io/projected/566a1416-3c42-402b-9a2c-4668348c5c0a-kube-api-access-fg8fg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.636363 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.636370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.636571 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.636395 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.737329 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.737294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg8fg\" (UniqueName: \"kubernetes.io/projected/566a1416-3c42-402b-9a2c-4668348c5c0a-kube-api-access-fg8fg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.737329 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.737333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.737524 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.737359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.737748 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.737727 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.737782 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.737739 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.747089 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.747066 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg8fg\" (UniqueName: \"kubernetes.io/projected/566a1416-3c42-402b-9a2c-4668348c5c0a-kube-api-access-fg8fg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:08.910652 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:08.910566 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:09.035405 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:09.035351 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69"] Jul 24 12:41:09.038010 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:41:09.037987 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566a1416_3c42_402b_9a2c_4668348c5c0a.slice/crio-05de1a86044661b483fe003cfb68a1715d7a0c91451ab71eabfaab74eb071c5b WatchSource:0}: Error finding container 05de1a86044661b483fe003cfb68a1715d7a0c91451ab71eabfaab74eb071c5b: Status 404 returned error can't find the container with id 05de1a86044661b483fe003cfb68a1715d7a0c91451ab71eabfaab74eb071c5b Jul 24 12:41:09.318408 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:09.318377 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" event={"ID":"566a1416-3c42-402b-9a2c-4668348c5c0a","Type":"ContainerStarted","Data":"05de1a86044661b483fe003cfb68a1715d7a0c91451ab71eabfaab74eb071c5b"} Jul 24 12:41:16.347077 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:16.347041 2560 generic.go:356] "Generic (PLEG): container finished" podID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerID="aa8355d9c5c5ee5f96262342c8e1ac0cb1de782bd405a019832333ecf1b2b693" exitCode=0 Jul 24 12:41:16.347469 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:16.347096 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" event={"ID":"566a1416-3c42-402b-9a2c-4668348c5c0a","Type":"ContainerDied","Data":"aa8355d9c5c5ee5f96262342c8e1ac0cb1de782bd405a019832333ecf1b2b693"} Jul 24 12:41:19.359646 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:19.359612 2560 generic.go:356] "Generic (PLEG): container finished" podID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerID="13104cde4298edcdd40bc489627295954e1e5563f5e9ea384195f5771e57e4f9" exitCode=0 Jul 24 12:41:19.360094 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:19.359698 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" event={"ID":"566a1416-3c42-402b-9a2c-4668348c5c0a","Type":"ContainerDied","Data":"13104cde4298edcdd40bc489627295954e1e5563f5e9ea384195f5771e57e4f9"} Jul 24 12:41:27.393122 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:27.393092 2560 generic.go:356] "Generic (PLEG): container finished" podID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerID="27668e6952cbe2ef1860f0b2a5e2a75baf62b20b0e4664b1a2e3a72d9330deac" exitCode=0 Jul 24 12:41:27.393467 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:27.393129 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" event={"ID":"566a1416-3c42-402b-9a2c-4668348c5c0a","Type":"ContainerDied","Data":"27668e6952cbe2ef1860f0b2a5e2a75baf62b20b0e4664b1a2e3a72d9330deac"} Jul 24 12:41:28.519402 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.519378 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:28.610816 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.610782 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-util\") pod \"566a1416-3c42-402b-9a2c-4668348c5c0a\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " Jul 24 12:41:28.611022 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.610848 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-bundle\") pod \"566a1416-3c42-402b-9a2c-4668348c5c0a\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " Jul 24 12:41:28.611022 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.610901 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg8fg\" (UniqueName: \"kubernetes.io/projected/566a1416-3c42-402b-9a2c-4668348c5c0a-kube-api-access-fg8fg\") pod \"566a1416-3c42-402b-9a2c-4668348c5c0a\" (UID: \"566a1416-3c42-402b-9a2c-4668348c5c0a\") " Jul 24 12:41:28.611695 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.611666 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-bundle" (OuterVolumeSpecName: "bundle") pod "566a1416-3c42-402b-9a2c-4668348c5c0a" (UID: "566a1416-3c42-402b-9a2c-4668348c5c0a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 12:41:28.613219 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.613186 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566a1416-3c42-402b-9a2c-4668348c5c0a-kube-api-access-fg8fg" (OuterVolumeSpecName: "kube-api-access-fg8fg") pod "566a1416-3c42-402b-9a2c-4668348c5c0a" (UID: "566a1416-3c42-402b-9a2c-4668348c5c0a"). InnerVolumeSpecName "kube-api-access-fg8fg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:41:28.615509 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.615488 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-util" (OuterVolumeSpecName: "util") pod "566a1416-3c42-402b-9a2c-4668348c5c0a" (UID: "566a1416-3c42-402b-9a2c-4668348c5c0a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 12:41:28.712000 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.711918 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-bundle\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:41:28.712000 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.711946 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg8fg\" (UniqueName: \"kubernetes.io/projected/566a1416-3c42-402b-9a2c-4668348c5c0a-kube-api-access-fg8fg\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:41:28.712000 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:28.711956 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/566a1416-3c42-402b-9a2c-4668348c5c0a-util\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:41:29.401345 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:29.401315 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" event={"ID":"566a1416-3c42-402b-9a2c-4668348c5c0a","Type":"ContainerDied","Data":"05de1a86044661b483fe003cfb68a1715d7a0c91451ab71eabfaab74eb071c5b"} Jul 24 12:41:29.401485 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:29.401360 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05de1a86044661b483fe003cfb68a1715d7a0c91451ab71eabfaab74eb071c5b" Jul 24 12:41:29.401485 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:29.401323 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dgr69" Jul 24 12:41:35.018245 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:35.018207 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:35.342383 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:35.342341 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:37.334404 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.334369 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4"] Jul 24 12:41:37.334915 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.334611 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerName="pull" Jul 24 12:41:37.334915 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.334622 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerName="pull" Jul 24 12:41:37.334915 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.334633 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerName="util" Jul 24 12:41:37.334915 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.334638 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerName="util" Jul 24 12:41:37.334915 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.334644 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerName="extract" Jul 24 12:41:37.334915 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.334649 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerName="extract" Jul 24 12:41:37.334915 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.334687 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="566a1416-3c42-402b-9a2c-4668348c5c0a" containerName="extract" Jul 24 12:41:37.366918 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.366889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" Jul 24 12:41:37.373975 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.373944 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kwqmt\"" Jul 24 12:41:37.374239 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.373987 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:41:37.375035 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.373987 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 24 12:41:37.376469 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.376445 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4"] Jul 24 12:41:37.475115 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.475082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggp82\" (UniqueName: \"kubernetes.io/projected/beb8d8f6-ff52-46b6-820f-cbe6f0c39036-kube-api-access-ggp82\") pod \"cert-manager-operator-controller-manager-56b4598547-m9xw4\" (UID: \"beb8d8f6-ff52-46b6-820f-cbe6f0c39036\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" Jul 24 12:41:37.475314 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.475131 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/beb8d8f6-ff52-46b6-820f-cbe6f0c39036-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-m9xw4\" (UID: \"beb8d8f6-ff52-46b6-820f-cbe6f0c39036\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" Jul 24 12:41:37.576299 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.576264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggp82\" (UniqueName: \"kubernetes.io/projected/beb8d8f6-ff52-46b6-820f-cbe6f0c39036-kube-api-access-ggp82\") pod \"cert-manager-operator-controller-manager-56b4598547-m9xw4\" (UID: \"beb8d8f6-ff52-46b6-820f-cbe6f0c39036\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" Jul 24 12:41:37.576299 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.576303 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/beb8d8f6-ff52-46b6-820f-cbe6f0c39036-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-m9xw4\" (UID: \"beb8d8f6-ff52-46b6-820f-cbe6f0c39036\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" Jul 24 12:41:37.576654 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.576639 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/beb8d8f6-ff52-46b6-820f-cbe6f0c39036-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-m9xw4\" (UID: \"beb8d8f6-ff52-46b6-820f-cbe6f0c39036\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" Jul 24 12:41:37.585523 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.585455 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggp82\" (UniqueName: \"kubernetes.io/projected/beb8d8f6-ff52-46b6-820f-cbe6f0c39036-kube-api-access-ggp82\") pod \"cert-manager-operator-controller-manager-56b4598547-m9xw4\" (UID: \"beb8d8f6-ff52-46b6-820f-cbe6f0c39036\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" Jul 24 12:41:37.681540 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.681515 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" Jul 24 12:41:37.836303 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:37.836207 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4"] Jul 24 12:41:37.839539 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:41:37.839510 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb8d8f6_ff52_46b6_820f_cbe6f0c39036.slice/crio-60894872f0acc9d2691d614af73ef2a52fcac76af7bfaab9665f9731ec19f99b WatchSource:0}: Error finding container 60894872f0acc9d2691d614af73ef2a52fcac76af7bfaab9665f9731ec19f99b: Status 404 returned error can't find the container with id 60894872f0acc9d2691d614af73ef2a52fcac76af7bfaab9665f9731ec19f99b Jul 24 12:41:38.434615 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:38.434572 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" event={"ID":"beb8d8f6-ff52-46b6-820f-cbe6f0c39036","Type":"ContainerStarted","Data":"60894872f0acc9d2691d614af73ef2a52fcac76af7bfaab9665f9731ec19f99b"} Jul 24 12:41:39.019143 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:39.019098 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:39.119488 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:39.119445 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:40.215410 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:40.215373 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:40.313755 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:40.313699 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:40.444182 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:40.444143 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" event={"ID":"beb8d8f6-ff52-46b6-820f-cbe6f0c39036","Type":"ContainerStarted","Data":"db7c5e8917b8c141b66005fb7739b834ff2a9ea5dc3b8dc4be809a0c659e1ccb"} Jul 24 12:41:41.037421 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:41.037383 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:42.679463 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:42.679427 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:43.085932 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.085896 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:43.436665 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.436565 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-m9xw4" podStartSLOduration=4.803185108 podStartE2EDuration="6.436548659s" totalImagesPullingTime="1.633363551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:41:40.476828639 +0000 UTC m=+248.636144993" watchObservedRunningTime="2026-07-24 12:41:43.436548659 +0000 UTC m=+251.595864994" Jul 24 12:41:43.437255 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.437235 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n47b4"] Jul 24 12:41:43.439649 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.439635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" Jul 24 12:41:43.447188 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.447167 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nt5lp\"" Jul 24 12:41:43.447310 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.447170 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 12:41:43.447957 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.447945 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 12:41:43.458534 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.458509 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n47b4"] Jul 24 12:41:43.524228 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.524193 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efad911f-ce72-43a5-b717-321764464eaa-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n47b4\" (UID: \"efad911f-ce72-43a5-b717-321764464eaa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" Jul 24 12:41:43.524388 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.524233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6x57\" (UniqueName: \"kubernetes.io/projected/efad911f-ce72-43a5-b717-321764464eaa-kube-api-access-b6x57\") pod \"cert-manager-cainjector-559cdd8c87-n47b4\" (UID: \"efad911f-ce72-43a5-b717-321764464eaa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" Jul 24 12:41:43.624967 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.624923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efad911f-ce72-43a5-b717-321764464eaa-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n47b4\" (UID: \"efad911f-ce72-43a5-b717-321764464eaa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" Jul 24 12:41:43.624967 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.624964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6x57\" (UniqueName: \"kubernetes.io/projected/efad911f-ce72-43a5-b717-321764464eaa-kube-api-access-b6x57\") pod \"cert-manager-cainjector-559cdd8c87-n47b4\" (UID: \"efad911f-ce72-43a5-b717-321764464eaa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" Jul 24 12:41:43.638986 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.638963 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6x57\" (UniqueName: \"kubernetes.io/projected/efad911f-ce72-43a5-b717-321764464eaa-kube-api-access-b6x57\") pod \"cert-manager-cainjector-559cdd8c87-n47b4\" (UID: \"efad911f-ce72-43a5-b717-321764464eaa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" Jul 24 12:41:43.645727 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.645701 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efad911f-ce72-43a5-b717-321764464eaa-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n47b4\" (UID: \"efad911f-ce72-43a5-b717-321764464eaa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" Jul 24 12:41:43.760306 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.760221 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" Jul 24 12:41:43.832782 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.832746 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:43.916734 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.916708 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n47b4"] Jul 24 12:41:43.918828 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:41:43.918801 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefad911f_ce72_43a5_b717_321764464eaa.slice/crio-59b80e1b52c90b2b520973d1dcf625edfb8391092ee6b2a41dc3228b9f0fac91 WatchSource:0}: Error finding container 59b80e1b52c90b2b520973d1dcf625edfb8391092ee6b2a41dc3228b9f0fac91: Status 404 returned error can't find the container with id 59b80e1b52c90b2b520973d1dcf625edfb8391092ee6b2a41dc3228b9f0fac91 Jul 24 12:41:43.943391 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:43.943359 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:44.461024 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:44.460992 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" event={"ID":"efad911f-ce72-43a5-b717-321764464eaa","Type":"ContainerStarted","Data":"59b80e1b52c90b2b520973d1dcf625edfb8391092ee6b2a41dc3228b9f0fac91"} Jul 24 12:41:47.475924 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:47.475795 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" event={"ID":"efad911f-ce72-43a5-b717-321764464eaa","Type":"ContainerStarted","Data":"b7eb8e9cc284994e6901f46c968fc7643142dc498ea32ea4649f7b2c99a451d2"} Jul 24 12:41:47.498667 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:47.498612 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n47b4" podStartSLOduration=1.232542853 podStartE2EDuration="4.498595168s" totalImagesPullingTime="3.266052315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:41:47.498018277 +0000 UTC m=+255.657334614" watchObservedRunningTime="2026-07-24 12:41:47.498595168 +0000 UTC m=+255.657911503" Jul 24 12:41:49.966062 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:49.966025 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:50.556261 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.556227 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8zhdz"] Jul 24 12:41:50.558567 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.558542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8zhdz" Jul 24 12:41:50.561359 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.561336 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-n7fk6\"" Jul 24 12:41:50.574568 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.574538 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8zhdz"] Jul 24 12:41:50.687830 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.687793 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8qgp\" (UniqueName: \"kubernetes.io/projected/789cda0d-5966-45b5-90fc-805acc6d7327-kube-api-access-w8qgp\") pod \"cert-manager-55b4d954d5-8zhdz\" (UID: \"789cda0d-5966-45b5-90fc-805acc6d7327\") " pod="cert-manager/cert-manager-55b4d954d5-8zhdz" Jul 24 12:41:50.688033 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.687853 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/789cda0d-5966-45b5-90fc-805acc6d7327-bound-sa-token\") pod \"cert-manager-55b4d954d5-8zhdz\" (UID: \"789cda0d-5966-45b5-90fc-805acc6d7327\") " pod="cert-manager/cert-manager-55b4d954d5-8zhdz" Jul 24 12:41:50.788752 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.788716 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8qgp\" (UniqueName: \"kubernetes.io/projected/789cda0d-5966-45b5-90fc-805acc6d7327-kube-api-access-w8qgp\") pod \"cert-manager-55b4d954d5-8zhdz\" (UID: \"789cda0d-5966-45b5-90fc-805acc6d7327\") " pod="cert-manager/cert-manager-55b4d954d5-8zhdz" Jul 24 12:41:50.788957 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.788777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/789cda0d-5966-45b5-90fc-805acc6d7327-bound-sa-token\") pod \"cert-manager-55b4d954d5-8zhdz\" (UID: \"789cda0d-5966-45b5-90fc-805acc6d7327\") " pod="cert-manager/cert-manager-55b4d954d5-8zhdz" Jul 24 12:41:50.799591 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.799566 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/789cda0d-5966-45b5-90fc-805acc6d7327-bound-sa-token\") pod \"cert-manager-55b4d954d5-8zhdz\" (UID: \"789cda0d-5966-45b5-90fc-805acc6d7327\") " pod="cert-manager/cert-manager-55b4d954d5-8zhdz" Jul 24 12:41:50.799784 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.799759 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8qgp\" (UniqueName: \"kubernetes.io/projected/789cda0d-5966-45b5-90fc-805acc6d7327-kube-api-access-w8qgp\") pod \"cert-manager-55b4d954d5-8zhdz\" (UID: \"789cda0d-5966-45b5-90fc-805acc6d7327\") " pod="cert-manager/cert-manager-55b4d954d5-8zhdz" Jul 24 12:41:50.867556 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:50.867474 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8zhdz" Jul 24 12:41:51.007838 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.007807 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8zhdz"] Jul 24 12:41:51.011422 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:41:51.011390 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod789cda0d_5966_45b5_90fc_805acc6d7327.slice/crio-5320900e12dce62019475c9b6f2846105b6498788038b529a5356194b8f23b15 WatchSource:0}: Error finding container 5320900e12dce62019475c9b6f2846105b6498788038b529a5356194b8f23b15: Status 404 returned error can't find the container with id 5320900e12dce62019475c9b6f2846105b6498788038b529a5356194b8f23b15 Jul 24 12:41:51.493197 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.493161 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8zhdz" event={"ID":"789cda0d-5966-45b5-90fc-805acc6d7327","Type":"ContainerStarted","Data":"b2b7b46648512c9ead9fa420ede6aa7c750d359385d661488fc7fc5bc57f8efe"} Jul 24 12:41:51.493197 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.493202 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8zhdz" event={"ID":"789cda0d-5966-45b5-90fc-805acc6d7327","Type":"ContainerStarted","Data":"5320900e12dce62019475c9b6f2846105b6498788038b529a5356194b8f23b15"} Jul 24 12:41:51.512309 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.512261 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8zhdz" podStartSLOduration=1.512246093 podStartE2EDuration="1.512246093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:41:51.510749013 +0000 UTC m=+259.670065348" watchObservedRunningTime="2026-07-24 12:41:51.512246093 +0000 UTC m=+259.671562429" Jul 24 12:41:51.714788 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.714757 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:51.812299 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.812270 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:51.943103 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.943072 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:41:51.969134 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.969101 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7"] Jul 24 12:41:51.971369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.971346 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:51.975668 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.975643 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 12:41:51.975668 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.975668 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 12:41:51.975945 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.975931 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cxdcp\"" Jul 24 12:41:51.989274 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:51.989240 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7"] Jul 24 12:41:52.099825 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.099732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bngct\" (UniqueName: \"kubernetes.io/projected/42fe28b9-f587-49bf-9037-a1d8b93a7d02-kube-api-access-bngct\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.099825 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.099789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.100247 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.099843 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.200441 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.200399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bngct\" (UniqueName: \"kubernetes.io/projected/42fe28b9-f587-49bf-9037-a1d8b93a7d02-kube-api-access-bngct\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.200641 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.200468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.200641 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.200516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.200822 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.200803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.200857 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.200824 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.209504 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.209480 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bngct\" (UniqueName: \"kubernetes.io/projected/42fe28b9-f587-49bf-9037-a1d8b93a7d02-kube-api-access-bngct\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.280366 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.280314 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:52.445951 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.445924 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7"] Jul 24 12:41:52.448339 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:41:52.448313 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fe28b9_f587_49bf_9037_a1d8b93a7d02.slice/crio-cbe37d8263d20ed4fb3af1176dfa206320bd7807cee30121df71a3e7d242b142 WatchSource:0}: Error finding container cbe37d8263d20ed4fb3af1176dfa206320bd7807cee30121df71a3e7d242b142: Status 404 returned error can't find the container with id cbe37d8263d20ed4fb3af1176dfa206320bd7807cee30121df71a3e7d242b142 Jul 24 12:41:52.498093 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:52.498060 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" event={"ID":"42fe28b9-f587-49bf-9037-a1d8b93a7d02","Type":"ContainerStarted","Data":"cbe37d8263d20ed4fb3af1176dfa206320bd7807cee30121df71a3e7d242b142"} Jul 24 12:41:53.503734 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:53.503696 2560 generic.go:356] "Generic (PLEG): container finished" podID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerID="95c0dc43e37a58207c237e8bd527b781b48d6aaff39923a2ab8a45d6f85a3522" exitCode=0 Jul 24 12:41:53.504149 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:53.503787 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" event={"ID":"42fe28b9-f587-49bf-9037-a1d8b93a7d02","Type":"ContainerDied","Data":"95c0dc43e37a58207c237e8bd527b781b48d6aaff39923a2ab8a45d6f85a3522"} Jul 24 12:41:56.520116 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:56.520079 2560 generic.go:356] "Generic (PLEG): container finished" podID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerID="4a402bfae842d715f3ad690a89fc1b4d3b69036e4602d56c027910e8473ff33e" exitCode=0 Jul 24 12:41:56.520586 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:56.520144 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" event={"ID":"42fe28b9-f587-49bf-9037-a1d8b93a7d02","Type":"ContainerDied","Data":"4a402bfae842d715f3ad690a89fc1b4d3b69036e4602d56c027910e8473ff33e"} Jul 24 12:41:57.525670 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:57.525640 2560 generic.go:356] "Generic (PLEG): container finished" podID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerID="6b4a2c25ad57954c0366ea7569aba3a6c43e41d06cb433c6b0967e97f5386af8" exitCode=0 Jul 24 12:41:57.526076 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:57.525703 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" event={"ID":"42fe28b9-f587-49bf-9037-a1d8b93a7d02","Type":"ContainerDied","Data":"6b4a2c25ad57954c0366ea7569aba3a6c43e41d06cb433c6b0967e97f5386af8"} Jul 24 12:41:58.658541 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.658515 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:58.752926 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.752863 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-bundle\") pod \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " Jul 24 12:41:58.753132 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.752971 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bngct\" (UniqueName: \"kubernetes.io/projected/42fe28b9-f587-49bf-9037-a1d8b93a7d02-kube-api-access-bngct\") pod \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " Jul 24 12:41:58.753132 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.753017 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-util\") pod \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\" (UID: \"42fe28b9-f587-49bf-9037-a1d8b93a7d02\") " Jul 24 12:41:58.753344 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.753320 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-bundle" (OuterVolumeSpecName: "bundle") pod "42fe28b9-f587-49bf-9037-a1d8b93a7d02" (UID: "42fe28b9-f587-49bf-9037-a1d8b93a7d02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 12:41:58.755321 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.755292 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42fe28b9-f587-49bf-9037-a1d8b93a7d02-kube-api-access-bngct" (OuterVolumeSpecName: "kube-api-access-bngct") pod "42fe28b9-f587-49bf-9037-a1d8b93a7d02" (UID: "42fe28b9-f587-49bf-9037-a1d8b93a7d02"). InnerVolumeSpecName "kube-api-access-bngct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:41:58.757763 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.757722 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-util" (OuterVolumeSpecName: "util") pod "42fe28b9-f587-49bf-9037-a1d8b93a7d02" (UID: "42fe28b9-f587-49bf-9037-a1d8b93a7d02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 12:41:58.853974 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.853844 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-bundle\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:41:58.853974 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.853916 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bngct\" (UniqueName: \"kubernetes.io/projected/42fe28b9-f587-49bf-9037-a1d8b93a7d02-kube-api-access-bngct\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:41:58.853974 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:58.853927 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42fe28b9-f587-49bf-9037-a1d8b93a7d02-util\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:41:59.535467 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:59.535436 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" Jul 24 12:41:59.535467 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:59.535449 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e28mw7" event={"ID":"42fe28b9-f587-49bf-9037-a1d8b93a7d02","Type":"ContainerDied","Data":"cbe37d8263d20ed4fb3af1176dfa206320bd7807cee30121df71a3e7d242b142"} Jul 24 12:41:59.535664 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:41:59.535500 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbe37d8263d20ed4fb3af1176dfa206320bd7807cee30121df71a3e7d242b142" Jul 24 12:42:02.127475 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:02.127432 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:42:02.238725 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:02.238694 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:42:03.531150 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.531119 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x"] Jul 24 12:42:03.531529 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.531415 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerName="pull" Jul 24 12:42:03.531529 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.531427 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerName="pull" Jul 24 12:42:03.531529 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.531441 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerName="extract" Jul 24 12:42:03.531529 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.531447 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerName="extract" Jul 24 12:42:03.531529 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.531457 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerName="util" Jul 24 12:42:03.531529 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.531463 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerName="util" Jul 24 12:42:03.531529 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.531513 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="42fe28b9-f587-49bf-9037-a1d8b93a7d02" containerName="extract" Jul 24 12:42:03.533469 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.533451 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" Jul 24 12:42:03.536046 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.536018 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:42:03.536046 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.536042 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 24 12:42:03.536196 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.536044 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-kldg9\"" Jul 24 12:42:03.543572 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.543543 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x"] Jul 24 12:42:03.589719 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.589678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb0f8e9-3691-497d-b78d-0ffb9578034a-tmp\") pod \"jobset-operator-5bc45f897-fsw5x\" (UID: \"7fb0f8e9-3691-497d-b78d-0ffb9578034a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" Jul 24 12:42:03.589924 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.589726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldhgj\" (UniqueName: \"kubernetes.io/projected/7fb0f8e9-3691-497d-b78d-0ffb9578034a-kube-api-access-ldhgj\") pod \"jobset-operator-5bc45f897-fsw5x\" (UID: \"7fb0f8e9-3691-497d-b78d-0ffb9578034a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" Jul 24 12:42:03.690941 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.690897 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb0f8e9-3691-497d-b78d-0ffb9578034a-tmp\") pod \"jobset-operator-5bc45f897-fsw5x\" (UID: \"7fb0f8e9-3691-497d-b78d-0ffb9578034a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" Jul 24 12:42:03.691121 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.690952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldhgj\" (UniqueName: \"kubernetes.io/projected/7fb0f8e9-3691-497d-b78d-0ffb9578034a-kube-api-access-ldhgj\") pod \"jobset-operator-5bc45f897-fsw5x\" (UID: \"7fb0f8e9-3691-497d-b78d-0ffb9578034a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" Jul 24 12:42:03.691278 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.691256 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb0f8e9-3691-497d-b78d-0ffb9578034a-tmp\") pod \"jobset-operator-5bc45f897-fsw5x\" (UID: \"7fb0f8e9-3691-497d-b78d-0ffb9578034a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" Jul 24 12:42:03.706716 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.706689 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldhgj\" (UniqueName: \"kubernetes.io/projected/7fb0f8e9-3691-497d-b78d-0ffb9578034a-kube-api-access-ldhgj\") pod \"jobset-operator-5bc45f897-fsw5x\" (UID: \"7fb0f8e9-3691-497d-b78d-0ffb9578034a\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" Jul 24 12:42:03.842906 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.842797 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" Jul 24 12:42:03.979207 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:03.979180 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x"] Jul 24 12:42:03.981701 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:42:03.981668 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fb0f8e9_3691_497d_b78d_0ffb9578034a.slice/crio-881768343b27d3a48a6c9a314e0908bb81dfaff710bcbe4969a06e3702d3099d WatchSource:0}: Error finding container 881768343b27d3a48a6c9a314e0908bb81dfaff710bcbe4969a06e3702d3099d: Status 404 returned error can't find the container with id 881768343b27d3a48a6c9a314e0908bb81dfaff710bcbe4969a06e3702d3099d Jul 24 12:42:04.556503 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:04.556465 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" event={"ID":"7fb0f8e9-3691-497d-b78d-0ffb9578034a","Type":"ContainerStarted","Data":"881768343b27d3a48a6c9a314e0908bb81dfaff710bcbe4969a06e3702d3099d"} Jul 24 12:42:06.567250 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:06.567217 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" event={"ID":"7fb0f8e9-3691-497d-b78d-0ffb9578034a","Type":"ContainerStarted","Data":"1547ce492f98e59b2620fe16a32999497d1acb19e6ebe4fa02e193feff28150b"} Jul 24 12:42:06.586353 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:06.586299 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fsw5x" podStartSLOduration=1.774264596 podStartE2EDuration="3.586282045s" totalImagesPullingTime="1.812017449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:42:06.585107992 +0000 UTC m=+274.744424358" watchObservedRunningTime="2026-07-24 12:42:06.586282045 +0000 UTC m=+274.745598381" Jul 24 12:42:12.460427 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:12.460391 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:42:14.482217 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:14.482188 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:42:19.470646 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:19.470598 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:42:19.572096 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:19.572053 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:42:23.207533 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:23.207502 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:42:32.216531 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:32.216503 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovn-acl-logging/0.log" Jul 24 12:42:32.222465 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:32.222441 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 12:42:32.224596 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:42:32.224576 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovn-acl-logging/0.log" Jul 24 12:43:09.746118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:09.746085 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:43:09.855426 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:09.855368 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:43:09.924860 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:09.924828 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6"] Jul 24 12:43:09.927853 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:09.927836 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:09.933551 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:09.933513 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-r9mxx\"" Jul 24 12:43:09.934518 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:09.934501 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 24 12:43:09.934603 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:09.934545 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 24 12:43:09.939096 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:09.939071 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6"] Jul 24 12:43:09.946444 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:09.946412 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:43:10.022689 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.022597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4rb\" (UniqueName: \"kubernetes.io/projected/b501b9b3-3718-4201-b58b-4578236da07c-kube-api-access-xz4rb\") pod \"trainer-operator-controller-manager-7dc4f8d8c9-nmqv6\" (UID: \"b501b9b3-3718-4201-b58b-4578236da07c\") " pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.022689 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.022660 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/b501b9b3-3718-4201-b58b-4578236da07c-manifests-work\") pod \"trainer-operator-controller-manager-7dc4f8d8c9-nmqv6\" (UID: \"b501b9b3-3718-4201-b58b-4578236da07c\") " pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.022927 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.022697 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b501b9b3-3718-4201-b58b-4578236da07c-tmp\") pod \"trainer-operator-controller-manager-7dc4f8d8c9-nmqv6\" (UID: \"b501b9b3-3718-4201-b58b-4578236da07c\") " pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.123109 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.123072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/b501b9b3-3718-4201-b58b-4578236da07c-manifests-work\") pod \"trainer-operator-controller-manager-7dc4f8d8c9-nmqv6\" (UID: \"b501b9b3-3718-4201-b58b-4578236da07c\") " pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.123109 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.123113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b501b9b3-3718-4201-b58b-4578236da07c-tmp\") pod \"trainer-operator-controller-manager-7dc4f8d8c9-nmqv6\" (UID: \"b501b9b3-3718-4201-b58b-4578236da07c\") " pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.123324 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.123181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4rb\" (UniqueName: \"kubernetes.io/projected/b501b9b3-3718-4201-b58b-4578236da07c-kube-api-access-xz4rb\") pod \"trainer-operator-controller-manager-7dc4f8d8c9-nmqv6\" (UID: \"b501b9b3-3718-4201-b58b-4578236da07c\") " pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.123555 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.123531 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/b501b9b3-3718-4201-b58b-4578236da07c-manifests-work\") pod \"trainer-operator-controller-manager-7dc4f8d8c9-nmqv6\" (UID: \"b501b9b3-3718-4201-b58b-4578236da07c\") " pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.123555 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.123542 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b501b9b3-3718-4201-b58b-4578236da07c-tmp\") pod \"trainer-operator-controller-manager-7dc4f8d8c9-nmqv6\" (UID: \"b501b9b3-3718-4201-b58b-4578236da07c\") " pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.132232 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.132199 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4rb\" (UniqueName: \"kubernetes.io/projected/b501b9b3-3718-4201-b58b-4578236da07c-kube-api-access-xz4rb\") pod \"trainer-operator-controller-manager-7dc4f8d8c9-nmqv6\" (UID: \"b501b9b3-3718-4201-b58b-4578236da07c\") " pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.238566 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.238534 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:10.375531 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.375509 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6"] Jul 24 12:43:10.378076 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:43:10.378048 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb501b9b3_3718_4201_b58b_4578236da07c.slice/crio-1c9b5c0c5a20ffcfe8b25aa8900e47536b737fdff204453dcb7a20049a419e9d WatchSource:0}: Error finding container 1c9b5c0c5a20ffcfe8b25aa8900e47536b737fdff204453dcb7a20049a419e9d: Status 404 returned error can't find the container with id 1c9b5c0c5a20ffcfe8b25aa8900e47536b737fdff204453dcb7a20049a419e9d Jul 24 12:43:10.380030 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.380000 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 12:43:10.839384 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:10.839341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" event={"ID":"b501b9b3-3718-4201-b58b-4578236da07c","Type":"ContainerStarted","Data":"1c9b5c0c5a20ffcfe8b25aa8900e47536b737fdff204453dcb7a20049a419e9d"} Jul 24 12:43:13.855247 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:13.855214 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" event={"ID":"b501b9b3-3718-4201-b58b-4578236da07c","Type":"ContainerStarted","Data":"43798eba3390b52be69fb9734707fb10660170f497aa0980f99c096917740592"} Jul 24 12:43:13.855623 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:13.855291 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:13.883337 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:13.883286 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" podStartSLOduration=2.287835748 podStartE2EDuration="4.883269189s" totalImagesPullingTime="2.595433441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:43:13.883059566 +0000 UTC m=+342.042375919" watchObservedRunningTime="2026-07-24 12:43:13.883269189 +0000 UTC m=+342.042585525" Jul 24 12:43:24.861918 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:24.861816 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-7dc4f8d8c9-nmqv6" Jul 24 12:43:57.177117 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:57.177084 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:43:57.281112 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:57.281057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:43:59.473760 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.473721 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z"] Jul 24 12:43:59.477751 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.477733 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.480198 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.480177 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 12:43:59.480198 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.480191 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 24 12:43:59.480369 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.480338 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 12:43:59.480511 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.480498 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 24 12:43:59.481244 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.481229 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-mxk8v\"" Jul 24 12:43:59.484212 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.484186 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:43:59.487505 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.487479 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z"] Jul 24 12:43:59.613518 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.613479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28b83ca0-db86-4565-89b4-54442cd8b280-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.613518 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.613520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/28b83ca0-db86-4565-89b4-54442cd8b280-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.613725 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.613634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mb8b\" (UniqueName: \"kubernetes.io/projected/28b83ca0-db86-4565-89b4-54442cd8b280-kube-api-access-7mb8b\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.714567 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.714528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mb8b\" (UniqueName: \"kubernetes.io/projected/28b83ca0-db86-4565-89b4-54442cd8b280-kube-api-access-7mb8b\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.714751 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.714589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28b83ca0-db86-4565-89b4-54442cd8b280-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.714751 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.714626 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/28b83ca0-db86-4565-89b4-54442cd8b280-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.715297 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.715278 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/28b83ca0-db86-4565-89b4-54442cd8b280-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.717255 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.717231 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28b83ca0-db86-4565-89b4-54442cd8b280-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.723962 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.723905 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mb8b\" (UniqueName: \"kubernetes.io/projected/28b83ca0-db86-4565-89b4-54442cd8b280-kube-api-access-7mb8b\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.753642 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.753605 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:43:59.787455 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.787411 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:43:59.928638 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:43:59.928477 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z"] Jul 24 12:43:59.931383 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:43:59.931351 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28b83ca0_db86_4565_89b4_54442cd8b280.slice/crio-78457b5c03a4dfd15b6ea236d3352ec1a4bcd14ed42bb5a1db31e8178e794f95 WatchSource:0}: Error finding container 78457b5c03a4dfd15b6ea236d3352ec1a4bcd14ed42bb5a1db31e8178e794f95: Status 404 returned error can't find the container with id 78457b5c03a4dfd15b6ea236d3352ec1a4bcd14ed42bb5a1db31e8178e794f95 Jul 24 12:44:00.048040 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:00.048001 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" event={"ID":"28b83ca0-db86-4565-89b4-54442cd8b280","Type":"ContainerStarted","Data":"78457b5c03a4dfd15b6ea236d3352ec1a4bcd14ed42bb5a1db31e8178e794f95"} Jul 24 12:44:03.066806 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:03.066767 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" event={"ID":"28b83ca0-db86-4565-89b4-54442cd8b280","Type":"ContainerStarted","Data":"ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442"} Jul 24 12:44:03.067348 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:03.066933 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:44:03.086712 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:03.086665 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" podStartSLOduration=1.53208744 podStartE2EDuration="4.08664487s" totalImagesPullingTime="2.55455743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:44:03.085992672 +0000 UTC m=+391.245309010" watchObservedRunningTime="2026-07-24 12:44:03.08664487 +0000 UTC m=+391.245961207" Jul 24 12:44:03.211087 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:03.211038 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:04.184105 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:04.184070 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:04.245669 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:04.245629 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:06.148605 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:06.148569 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:06.268492 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:06.268456 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:19.077209 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:19.077179 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:44:21.319419 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.319365 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:21.339074 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.339042 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-qtcqm"] Jul 24 12:44:21.347667 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.347638 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" Jul 24 12:44:21.350550 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.350521 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qkxzt\"" Jul 24 12:44:21.352150 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.352121 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-qtcqm"] Jul 24 12:44:21.395178 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.395142 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hc2x\" (UniqueName: \"kubernetes.io/projected/dffecec3-bbc4-40b4-9898-0fdbc9dc0c05-kube-api-access-8hc2x\") pod \"test-trainjob-workflow-node-0-0-qtcqm\" (UID: \"dffecec3-bbc4-40b4-9898-0fdbc9dc0c05\") " pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" Jul 24 12:44:21.496208 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.496175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hc2x\" (UniqueName: \"kubernetes.io/projected/dffecec3-bbc4-40b4-9898-0fdbc9dc0c05-kube-api-access-8hc2x\") pod \"test-trainjob-workflow-node-0-0-qtcqm\" (UID: \"dffecec3-bbc4-40b4-9898-0fdbc9dc0c05\") " pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" Jul 24 12:44:21.504535 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.504508 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hc2x\" (UniqueName: \"kubernetes.io/projected/dffecec3-bbc4-40b4-9898-0fdbc9dc0c05-kube-api-access-8hc2x\") pod \"test-trainjob-workflow-node-0-0-qtcqm\" (UID: \"dffecec3-bbc4-40b4-9898-0fdbc9dc0c05\") " pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" Jul 24 12:44:21.658409 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.658312 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" Jul 24 12:44:21.796385 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:21.796361 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-qtcqm"] Jul 24 12:44:21.798063 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:44:21.798035 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddffecec3_bbc4_40b4_9898_0fdbc9dc0c05.slice/crio-d8bd3f52d8780b01edd692cd78199eda1ca4e2df4b9767a61511a3e3c30a31e4 WatchSource:0}: Error finding container d8bd3f52d8780b01edd692cd78199eda1ca4e2df4b9767a61511a3e3c30a31e4: Status 404 returned error can't find the container with id d8bd3f52d8780b01edd692cd78199eda1ca4e2df4b9767a61511a3e3c30a31e4 Jul 24 12:44:22.156060 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:22.156016 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" event={"ID":"dffecec3-bbc4-40b4-9898-0fdbc9dc0c05","Type":"ContainerStarted","Data":"d8bd3f52d8780b01edd692cd78199eda1ca4e2df4b9767a61511a3e3c30a31e4"} Jul 24 12:44:34.168513 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.168477 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d499666c-kq6tk"] Jul 24 12:44:34.181456 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.181422 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.185720 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.185653 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d499666c-kq6tk"] Jul 24 12:44:34.232318 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.232279 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:34.292409 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.292356 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:34.320099 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.320056 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-console-config\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.320486 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.320123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-service-ca\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.320486 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.320159 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r58g5\" (UniqueName: \"kubernetes.io/projected/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-kube-api-access-r58g5\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.320486 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.320232 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-console-oauth-config\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.320486 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.320273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-console-serving-cert\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.320486 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.320305 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-trusted-ca-bundle\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.320486 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.320337 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-oauth-serving-cert\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.360666 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.360527 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:34.421682 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.421596 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-service-ca\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.421682 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.421655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58g5\" (UniqueName: \"kubernetes.io/projected/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-kube-api-access-r58g5\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.421924 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.421692 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-console-oauth-config\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.421924 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.421718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-console-serving-cert\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.422378 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.422056 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-trusted-ca-bundle\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.422516 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.422469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-oauth-serving-cert\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.422593 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.422568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-console-config\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.422654 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.422634 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-service-ca\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.422948 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.422870 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-trusted-ca-bundle\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.423154 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.423129 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-oauth-serving-cert\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.423244 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.423183 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-console-config\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.424662 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.424638 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-console-serving-cert\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.425437 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.425418 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-console-oauth-config\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.427541 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.427521 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:34.430607 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.430568 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r58g5\" (UniqueName: \"kubernetes.io/projected/64de5b22-fc66-4e1a-9a37-52f78d27bd3a-kube-api-access-r58g5\") pod \"console-74d499666c-kq6tk\" (UID: \"64de5b22-fc66-4e1a-9a37-52f78d27bd3a\") " pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.494368 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.494325 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:34.956467 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:34.956423 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:35.023497 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:35.023337 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:40.540064 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:40.540027 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:46.484277 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:46.484243 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:49.708327 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:49.708297 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d499666c-kq6tk"] Jul 24 12:44:49.710368 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:44:49.710336 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64de5b22_fc66_4e1a_9a37_52f78d27bd3a.slice/crio-c473788c531469682011539ab4b23c2f30de3877d90b74524145664f961e5bf2 WatchSource:0}: Error finding container c473788c531469682011539ab4b23c2f30de3877d90b74524145664f961e5bf2: Status 404 returned error can't find the container with id c473788c531469682011539ab4b23c2f30de3877d90b74524145664f961e5bf2 Jul 24 12:44:50.321366 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:50.321328 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d499666c-kq6tk" event={"ID":"64de5b22-fc66-4e1a-9a37-52f78d27bd3a","Type":"ContainerStarted","Data":"9df31299b2b8fee747685c0b6ea98f17ba552bc7d44113ad63fa365fedb0d262"} Jul 24 12:44:50.321660 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:50.321382 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d499666c-kq6tk" event={"ID":"64de5b22-fc66-4e1a-9a37-52f78d27bd3a","Type":"ContainerStarted","Data":"c473788c531469682011539ab4b23c2f30de3877d90b74524145664f961e5bf2"} Jul 24 12:44:50.344829 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:50.344775 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d499666c-kq6tk" podStartSLOduration=16.344756483 podStartE2EDuration="16.344756483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:44:50.342694118 +0000 UTC m=+438.502010454" watchObservedRunningTime="2026-07-24 12:44:50.344756483 +0000 UTC m=+438.504072819" Jul 24 12:44:54.494956 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:54.494838 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:54.494956 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:54.494919 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:54.499715 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:54.499692 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:55.351845 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:55.351815 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d499666c-kq6tk" Jul 24 12:44:55.402911 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:55.402859 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd8cd464d-cqrjp"] Jul 24 12:44:55.521436 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:55.521371 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:55.622800 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:55.622655 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:44:55.724018 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:44:55.723922 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:45:20.433088 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:20.433024 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fd8cd464d-cqrjp" podUID="c7fa1472-9c18-4af2-8796-ff4369a43f26" containerName="console" containerID="cri-o://d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c" gracePeriod=15 Jul 24 12:45:23.120725 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:23.120672 2560 patch_prober.go:28] interesting pod/console-7fd8cd464d-cqrjp container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.135.0.18:8443/health\": dial tcp 10.135.0.18:8443: connect: connection refused" start-of-body= Jul 24 12:45:23.121186 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:23.120759 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7fd8cd464d-cqrjp" podUID="c7fa1472-9c18-4af2-8796-ff4369a43f26" containerName="console" probeResult="failure" output="Get \"https://10.135.0.18:8443/health\": dial tcp 10.135.0.18:8443: connect: connection refused" Jul 24 12:45:27.857587 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.857557 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:45:27.975927 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.975885 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-config\") pod \"c7fa1472-9c18-4af2-8796-ff4369a43f26\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " Jul 24 12:45:27.976115 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.975945 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5vc7\" (UniqueName: \"kubernetes.io/projected/c7fa1472-9c18-4af2-8796-ff4369a43f26-kube-api-access-g5vc7\") pod \"c7fa1472-9c18-4af2-8796-ff4369a43f26\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " Jul 24 12:45:27.976115 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976003 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-trusted-ca-bundle\") pod \"c7fa1472-9c18-4af2-8796-ff4369a43f26\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " Jul 24 12:45:27.976115 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976025 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-oauth-serving-cert\") pod \"c7fa1472-9c18-4af2-8796-ff4369a43f26\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " Jul 24 12:45:27.976115 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976058 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-service-ca\") pod \"c7fa1472-9c18-4af2-8796-ff4369a43f26\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " Jul 24 12:45:27.976115 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976100 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-serving-cert\") pod \"c7fa1472-9c18-4af2-8796-ff4369a43f26\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " Jul 24 12:45:27.976356 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976161 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-oauth-config\") pod \"c7fa1472-9c18-4af2-8796-ff4369a43f26\" (UID: \"c7fa1472-9c18-4af2-8796-ff4369a43f26\") " Jul 24 12:45:27.976356 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976266 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-config" (OuterVolumeSpecName: "console-config") pod "c7fa1472-9c18-4af2-8796-ff4369a43f26" (UID: "c7fa1472-9c18-4af2-8796-ff4369a43f26"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:45:27.976465 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976443 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:27.976465 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976447 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7fa1472-9c18-4af2-8796-ff4369a43f26" (UID: "c7fa1472-9c18-4af2-8796-ff4369a43f26"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:45:27.976570 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976492 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7fa1472-9c18-4af2-8796-ff4369a43f26" (UID: "c7fa1472-9c18-4af2-8796-ff4369a43f26"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:45:27.976781 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.976756 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7fa1472-9c18-4af2-8796-ff4369a43f26" (UID: "c7fa1472-9c18-4af2-8796-ff4369a43f26"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:45:27.978529 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.978505 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7fa1472-9c18-4af2-8796-ff4369a43f26" (UID: "c7fa1472-9c18-4af2-8796-ff4369a43f26"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:45:27.978918 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.978895 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7fa1472-9c18-4af2-8796-ff4369a43f26-kube-api-access-g5vc7" (OuterVolumeSpecName: "kube-api-access-g5vc7") pod "c7fa1472-9c18-4af2-8796-ff4369a43f26" (UID: "c7fa1472-9c18-4af2-8796-ff4369a43f26"). InnerVolumeSpecName "kube-api-access-g5vc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:45:27.978998 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:27.978982 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7fa1472-9c18-4af2-8796-ff4369a43f26" (UID: "c7fa1472-9c18-4af2-8796-ff4369a43f26"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:45:28.077668 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.077599 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-oauth-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:28.077668 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.077626 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5vc7\" (UniqueName: \"kubernetes.io/projected/c7fa1472-9c18-4af2-8796-ff4369a43f26-kube-api-access-g5vc7\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:28.077668 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.077639 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-trusted-ca-bundle\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:28.077668 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.077651 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-oauth-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:28.077668 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.077664 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fa1472-9c18-4af2-8796-ff4369a43f26-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:28.077919 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.077676 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fa1472-9c18-4af2-8796-ff4369a43f26-console-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:28.510766 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.510726 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" event={"ID":"dffecec3-bbc4-40b4-9898-0fdbc9dc0c05","Type":"ContainerStarted","Data":"cac1ecf99ef1816fc1391a92440e69a5a93f7e3cacc4dc7df4e2381a14beb735"} Jul 24 12:45:28.511959 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.511934 2560 generic.go:356] "Generic (PLEG): container finished" podID="c7fa1472-9c18-4af2-8796-ff4369a43f26" containerID="d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c" exitCode=0 Jul 24 12:45:28.512093 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.511979 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd8cd464d-cqrjp" Jul 24 12:45:28.512093 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.512023 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd8cd464d-cqrjp" event={"ID":"c7fa1472-9c18-4af2-8796-ff4369a43f26","Type":"ContainerDied","Data":"d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c"} Jul 24 12:45:28.512093 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.512078 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd8cd464d-cqrjp" event={"ID":"c7fa1472-9c18-4af2-8796-ff4369a43f26","Type":"ContainerDied","Data":"d0d22d4a9d1334102494b7d2d185e93126ce76c9053374f1af79c475d083d5eb"} Jul 24 12:45:28.512249 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.512105 2560 scope.go:117] "RemoveContainer" containerID="d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c" Jul 24 12:45:28.521098 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.521078 2560 scope.go:117] "RemoveContainer" containerID="d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c" Jul 24 12:45:28.521372 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:45:28.521354 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c\": container with ID starting with d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c not found: ID does not exist" containerID="d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c" Jul 24 12:45:28.521418 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.521380 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c"} err="failed to get container status \"d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c\": rpc error: code = NotFound desc = could not find container \"d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c\": container with ID starting with d47bb0103c40c2f83942e6d576f65963119fafcecb3d35140faeea995781574c not found: ID does not exist" Jul 24 12:45:28.527017 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.526980 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" podStartSLOduration=1.276333476 podStartE2EDuration="1m7.526968408s" totalImagesPullingTime="1m6.250634932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:45:28.526057858 +0000 UTC m=+476.685374216" watchObservedRunningTime="2026-07-24 12:45:28.526968408 +0000 UTC m=+476.686284743" Jul 24 12:45:28.547980 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.547945 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd8cd464d-cqrjp"] Jul 24 12:45:28.549484 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:28.549463 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fd8cd464d-cqrjp"] Jul 24 12:45:30.370804 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:30.370760 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7fa1472-9c18-4af2-8796-ff4369a43f26" path="/var/lib/kubelet/pods/c7fa1472-9c18-4af2-8796-ff4369a43f26/volumes" Jul 24 12:45:31.528149 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:31.528115 2560 generic.go:356] "Generic (PLEG): container finished" podID="dffecec3-bbc4-40b4-9898-0fdbc9dc0c05" containerID="cac1ecf99ef1816fc1391a92440e69a5a93f7e3cacc4dc7df4e2381a14beb735" exitCode=0 Jul 24 12:45:31.528517 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:31.528164 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" event={"ID":"dffecec3-bbc4-40b4-9898-0fdbc9dc0c05","Type":"ContainerDied","Data":"cac1ecf99ef1816fc1391a92440e69a5a93f7e3cacc4dc7df4e2381a14beb735"} Jul 24 12:45:32.694092 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:32.694063 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" Jul 24 12:45:32.823039 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:32.822969 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hc2x\" (UniqueName: \"kubernetes.io/projected/dffecec3-bbc4-40b4-9898-0fdbc9dc0c05-kube-api-access-8hc2x\") pod \"dffecec3-bbc4-40b4-9898-0fdbc9dc0c05\" (UID: \"dffecec3-bbc4-40b4-9898-0fdbc9dc0c05\") " Jul 24 12:45:32.825202 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:32.825171 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dffecec3-bbc4-40b4-9898-0fdbc9dc0c05-kube-api-access-8hc2x" (OuterVolumeSpecName: "kube-api-access-8hc2x") pod "dffecec3-bbc4-40b4-9898-0fdbc9dc0c05" (UID: "dffecec3-bbc4-40b4-9898-0fdbc9dc0c05"). InnerVolumeSpecName "kube-api-access-8hc2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:45:32.924473 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:32.924434 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hc2x\" (UniqueName: \"kubernetes.io/projected/dffecec3-bbc4-40b4-9898-0fdbc9dc0c05-kube-api-access-8hc2x\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:33.537404 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:33.537371 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" Jul 24 12:45:33.537404 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:33.537392 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-qtcqm" event={"ID":"dffecec3-bbc4-40b4-9898-0fdbc9dc0c05","Type":"ContainerDied","Data":"d8bd3f52d8780b01edd692cd78199eda1ca4e2df4b9767a61511a3e3c30a31e4"} Jul 24 12:45:33.537705 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:33.537425 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8bd3f52d8780b01edd692cd78199eda1ca4e2df4b9767a61511a3e3c30a31e4" Jul 24 12:45:34.719065 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:34.719032 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-qtcqm"] Jul 24 12:45:34.726967 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:34.726937 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-qtcqm"] Jul 24 12:45:34.788057 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:34.788021 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:45:35.077008 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.076961 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:45:35.086468 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.086440 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z"] Jul 24 12:45:35.086629 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.086610 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" podUID="28b83ca0-db86-4565-89b4-54442cd8b280" containerName="manager" containerID="cri-o://ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442" gracePeriod=30 Jul 24 12:45:35.233173 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.233107 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:45:35.365844 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.365809 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:45:35.545247 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.545218 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/28b83ca0-db86-4565-89b4-54442cd8b280-kubeflow-trainer-config\") pod \"28b83ca0-db86-4565-89b4-54442cd8b280\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " Jul 24 12:45:35.545434 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.545280 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28b83ca0-db86-4565-89b4-54442cd8b280-cert\") pod \"28b83ca0-db86-4565-89b4-54442cd8b280\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " Jul 24 12:45:35.545434 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.545335 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mb8b\" (UniqueName: \"kubernetes.io/projected/28b83ca0-db86-4565-89b4-54442cd8b280-kube-api-access-7mb8b\") pod \"28b83ca0-db86-4565-89b4-54442cd8b280\" (UID: \"28b83ca0-db86-4565-89b4-54442cd8b280\") " Jul 24 12:45:35.548348 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.548290 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b83ca0-db86-4565-89b4-54442cd8b280-kube-api-access-7mb8b" (OuterVolumeSpecName: "kube-api-access-7mb8b") pod "28b83ca0-db86-4565-89b4-54442cd8b280" (UID: "28b83ca0-db86-4565-89b4-54442cd8b280"). InnerVolumeSpecName "kube-api-access-7mb8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:45:35.551226 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.551167 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b83ca0-db86-4565-89b4-54442cd8b280-cert" (OuterVolumeSpecName: "cert") pod "28b83ca0-db86-4565-89b4-54442cd8b280" (UID: "28b83ca0-db86-4565-89b4-54442cd8b280"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:45:35.551374 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.551286 2560 generic.go:356] "Generic (PLEG): container finished" podID="28b83ca0-db86-4565-89b4-54442cd8b280" containerID="ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442" exitCode=0 Jul 24 12:45:35.551374 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.551364 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" Jul 24 12:45:35.551487 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.551384 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" event={"ID":"28b83ca0-db86-4565-89b4-54442cd8b280","Type":"ContainerDied","Data":"ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442"} Jul 24 12:45:35.551487 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.551420 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z" event={"ID":"28b83ca0-db86-4565-89b4-54442cd8b280","Type":"ContainerDied","Data":"78457b5c03a4dfd15b6ea236d3352ec1a4bcd14ed42bb5a1db31e8178e794f95"} Jul 24 12:45:35.551487 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.551444 2560 scope.go:117] "RemoveContainer" containerID="ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442" Jul 24 12:45:35.552281 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.552254 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b83ca0-db86-4565-89b4-54442cd8b280-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "28b83ca0-db86-4565-89b4-54442cd8b280" (UID: "28b83ca0-db86-4565-89b4-54442cd8b280"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:45:35.560702 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.560507 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:45:35.569182 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.569151 2560 scope.go:117] "RemoveContainer" containerID="ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442" Jul 24 12:45:35.569549 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:45:35.569525 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442\": container with ID starting with ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442 not found: ID does not exist" containerID="ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442" Jul 24 12:45:35.569636 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.569557 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442"} err="failed to get container status \"ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442\": rpc error: code = NotFound desc = could not find container \"ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442\": container with ID starting with ada84f61c79ecaf6436afb8824a7268dbfaddc6b397e0ea5e00e9b53f283a442 not found: ID does not exist" Jul 24 12:45:35.646330 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.646249 2560 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/28b83ca0-db86-4565-89b4-54442cd8b280-kubeflow-trainer-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:35.646330 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.646279 2560 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28b83ca0-db86-4565-89b4-54442cd8b280-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:35.646330 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.646289 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mb8b\" (UniqueName: \"kubernetes.io/projected/28b83ca0-db86-4565-89b4-54442cd8b280-kube-api-access-7mb8b\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:45:35.711324 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711291 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-drxp8/must-gather-dwvgb"] Jul 24 12:45:35.711605 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711594 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dffecec3-bbc4-40b4-9898-0fdbc9dc0c05" containerName="node" Jul 24 12:45:35.711653 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711607 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dffecec3-bbc4-40b4-9898-0fdbc9dc0c05" containerName="node" Jul 24 12:45:35.711653 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711620 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b83ca0-db86-4565-89b4-54442cd8b280" containerName="manager" Jul 24 12:45:35.711653 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711625 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b83ca0-db86-4565-89b4-54442cd8b280" containerName="manager" Jul 24 12:45:35.711653 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711636 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7fa1472-9c18-4af2-8796-ff4369a43f26" containerName="console" Jul 24 12:45:35.711653 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711641 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fa1472-9c18-4af2-8796-ff4369a43f26" containerName="console" Jul 24 12:45:35.711797 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711693 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b83ca0-db86-4565-89b4-54442cd8b280" containerName="manager" Jul 24 12:45:35.711797 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711702 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dffecec3-bbc4-40b4-9898-0fdbc9dc0c05" containerName="node" Jul 24 12:45:35.711797 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.711711 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7fa1472-9c18-4af2-8796-ff4369a43f26" containerName="console" Jul 24 12:45:35.742550 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.742517 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drxp8/must-gather-dwvgb"] Jul 24 12:45:35.743040 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.742633 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:45:35.747709 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.747686 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-drxp8\"/\"default-dockercfg-vjsxk\"" Jul 24 12:45:35.747999 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.747978 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-drxp8\"/\"kube-root-ca.crt\"" Jul 24 12:45:35.749054 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.749016 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:45:35.749054 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.749041 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-drxp8\"/\"openshift-service-ca.crt\"" Jul 24 12:45:35.848135 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.848094 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kh4m\" (UniqueName: \"kubernetes.io/projected/b602b18c-4402-4f22-8ab2-207c9b0f08a6-kube-api-access-8kh4m\") pod \"must-gather-dwvgb\" (UID: \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\") " pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:45:35.848316 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.848204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b602b18c-4402-4f22-8ab2-207c9b0f08a6-must-gather-output\") pod \"must-gather-dwvgb\" (UID: \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\") " pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:45:35.877689 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.877657 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z"] Jul 24 12:45:35.879117 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.879095 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-6t56z"] Jul 24 12:45:35.906744 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.906672 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:45:35.948815 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.948783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b602b18c-4402-4f22-8ab2-207c9b0f08a6-must-gather-output\") pod \"must-gather-dwvgb\" (UID: \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\") " pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:45:35.949011 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.948833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kh4m\" (UniqueName: \"kubernetes.io/projected/b602b18c-4402-4f22-8ab2-207c9b0f08a6-kube-api-access-8kh4m\") pod \"must-gather-dwvgb\" (UID: \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\") " pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:45:35.949167 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.949147 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b602b18c-4402-4f22-8ab2-207c9b0f08a6-must-gather-output\") pod \"must-gather-dwvgb\" (UID: \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\") " pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:45:35.962093 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:35.962064 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kh4m\" (UniqueName: \"kubernetes.io/projected/b602b18c-4402-4f22-8ab2-207c9b0f08a6-kube-api-access-8kh4m\") pod \"must-gather-dwvgb\" (UID: \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\") " pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:45:36.052314 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:36.052273 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:45:36.211575 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:36.211497 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drxp8/must-gather-dwvgb"] Jul 24 12:45:36.215451 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:45:36.215424 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb602b18c_4402_4f22_8ab2_207c9b0f08a6.slice/crio-cd89ec16a35a06774c51324acdbfd09f42be535e957dfede6e7803950913580c WatchSource:0}: Error finding container cd89ec16a35a06774c51324acdbfd09f42be535e957dfede6e7803950913580c: Status 404 returned error can't find the container with id cd89ec16a35a06774c51324acdbfd09f42be535e957dfede6e7803950913580c Jul 24 12:45:36.370398 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:36.370363 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28b83ca0-db86-4565-89b4-54442cd8b280" path="/var/lib/kubelet/pods/28b83ca0-db86-4565-89b4-54442cd8b280/volumes" Jul 24 12:45:36.370731 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:36.370717 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dffecec3-bbc4-40b4-9898-0fdbc9dc0c05" path="/var/lib/kubelet/pods/dffecec3-bbc4-40b4-9898-0fdbc9dc0c05/volumes" Jul 24 12:45:36.557223 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:36.557189 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drxp8/must-gather-dwvgb" event={"ID":"b602b18c-4402-4f22-8ab2-207c9b0f08a6","Type":"ContainerStarted","Data":"cd89ec16a35a06774c51324acdbfd09f42be535e957dfede6e7803950913580c"} Jul 24 12:45:45.609484 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:45.609443 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drxp8/must-gather-dwvgb" event={"ID":"b602b18c-4402-4f22-8ab2-207c9b0f08a6","Type":"ContainerStarted","Data":"ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0"} Jul 24 12:45:45.609943 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:45.609498 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drxp8/must-gather-dwvgb" event={"ID":"b602b18c-4402-4f22-8ab2-207c9b0f08a6","Type":"ContainerStarted","Data":"d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041"} Jul 24 12:45:45.631854 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:45:45.631795 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-drxp8/must-gather-dwvgb" podStartSLOduration=2.291025359 podStartE2EDuration="10.631777651s" totalImagesPullingTime="8.340752292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:45:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:45:45.626050157 +0000 UTC m=+493.785366494" watchObservedRunningTime="2026-07-24 12:45:45.631777651 +0000 UTC m=+493.791093987" Jul 24 12:46:19.201104 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:19.201067 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:46:19.275099 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:19.275059 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:46:32.545915 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:32.545833 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:46:32.617512 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:32.617468 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:46:33.859461 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:33.859423 2560 generic.go:356] "Generic (PLEG): container finished" podID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" containerID="d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041" exitCode=0 Jul 24 12:46:33.859909 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:33.859497 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drxp8/must-gather-dwvgb" event={"ID":"b602b18c-4402-4f22-8ab2-207c9b0f08a6","Type":"ContainerDied","Data":"d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041"} Jul 24 12:46:33.859909 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:33.859794 2560 scope.go:117] "RemoveContainer" containerID="d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041" Jul 24 12:46:34.100965 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:34.100931 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-drxp8_must-gather-dwvgb_b602b18c-4402-4f22-8ab2-207c9b0f08a6/gather/0.log" Jul 24 12:46:34.500840 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:34.500800 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:46:34.664174 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:34.664069 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:46:34.764258 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:34.764225 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:46:37.184157 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:37.184122 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-49lt9_68d749be-07e2-42c1-a702-6e5fef952f66/global-pull-secret-syncer/0.log" Jul 24 12:46:37.362319 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:37.362292 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" Jul 24 12:46:37.471438 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:37.471349 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-28.ec2.internal_f0f6325ce07165ebf2e9979367b54cf4/haproxy/0.log" Jul 24 12:46:39.479756 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.479719 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-drxp8/must-gather-dwvgb"] Jul 24 12:46:39.480213 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.479923 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-drxp8/must-gather-dwvgb" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" containerName="copy" containerID="cri-o://ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0" gracePeriod=2 Jul 24 12:46:39.485594 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.485555 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-drxp8/must-gather-dwvgb"] Jul 24 12:46:39.722058 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.722033 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-drxp8_must-gather-dwvgb_b602b18c-4402-4f22-8ab2-207c9b0f08a6/copy/0.log" Jul 24 12:46:39.723747 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.723725 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:46:39.725994 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:46:39.725969 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dwvgb\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-drxp8\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:46:39.885541 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.885515 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-drxp8_must-gather-dwvgb_b602b18c-4402-4f22-8ab2-207c9b0f08a6/copy/0.log" Jul 24 12:46:39.885851 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.885827 2560 generic.go:356] "Generic (PLEG): container finished" podID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" containerID="ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0" exitCode=143 Jul 24 12:46:39.885930 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.885914 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:46:39.885977 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.885932 2560 scope.go:117] "RemoveContainer" containerID="ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0" Jul 24 12:46:39.888073 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:46:39.888047 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dwvgb\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-drxp8\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:46:39.893548 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.893525 2560 scope.go:117] "RemoveContainer" containerID="d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041" Jul 24 12:46:39.906101 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.906081 2560 scope.go:117] "RemoveContainer" containerID="ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0" Jul 24 12:46:39.906293 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.906275 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b602b18c-4402-4f22-8ab2-207c9b0f08a6-must-gather-output\") pod \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\" (UID: \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\") " Jul 24 12:46:39.906358 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.906311 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kh4m\" (UniqueName: \"kubernetes.io/projected/b602b18c-4402-4f22-8ab2-207c9b0f08a6-kube-api-access-8kh4m\") pod \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\" (UID: \"b602b18c-4402-4f22-8ab2-207c9b0f08a6\") " Jul 24 12:46:39.906518 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:46:39.906493 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0\": container with ID starting with ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0 not found: ID does not exist" containerID="ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0" Jul 24 12:46:39.906558 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.906533 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0"} err="failed to get container status \"ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0\": rpc error: code = NotFound desc = could not find container \"ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0\": container with ID starting with ac58503bbe0717656dd35428d86d1bb26d0d0ec9993c15a72e6f8c81d40b6ad0 not found: ID does not exist" Jul 24 12:46:39.906602 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.906560 2560 scope.go:117] "RemoveContainer" containerID="d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041" Jul 24 12:46:39.906925 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:46:39.906898 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041\": container with ID starting with d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041 not found: ID does not exist" containerID="d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041" Jul 24 12:46:39.907020 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.906933 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041"} err="failed to get container status \"d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041\": rpc error: code = NotFound desc = could not find container \"d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041\": container with ID starting with d81babc8eb4685e2618dade3bd614cb794c9a007b366cb5dd824254b494e7041 not found: ID does not exist" Jul 24 12:46:39.907585 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.907566 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b602b18c-4402-4f22-8ab2-207c9b0f08a6-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b602b18c-4402-4f22-8ab2-207c9b0f08a6" (UID: "b602b18c-4402-4f22-8ab2-207c9b0f08a6"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 12:46:39.908590 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:39.908565 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b602b18c-4402-4f22-8ab2-207c9b0f08a6-kube-api-access-8kh4m" (OuterVolumeSpecName: "kube-api-access-8kh4m") pod "b602b18c-4402-4f22-8ab2-207c9b0f08a6" (UID: "b602b18c-4402-4f22-8ab2-207c9b0f08a6"). InnerVolumeSpecName "kube-api-access-8kh4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:46:40.007871 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:40.007832 2560 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b602b18c-4402-4f22-8ab2-207c9b0f08a6-must-gather-output\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:46:40.007871 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:40.007861 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kh4m\" (UniqueName: \"kubernetes.io/projected/b602b18c-4402-4f22-8ab2-207c9b0f08a6-kube-api-access-8kh4m\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\"" Jul 24 12:46:40.196779 ip-10-0-134-28 kubenswrapper[2560]: E0724 12:46:40.196747 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dwvgb\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-drxp8\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" pod="openshift-must-gather-drxp8/must-gather-dwvgb" Jul 24 12:46:40.369827 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:40.369793 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" path="/var/lib/kubelet/pods/b602b18c-4402-4f22-8ab2-207c9b0f08a6/volumes" Jul 24 12:46:40.379577 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:40.379546 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:46:40.447665 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:40.447570 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-64mm7_7124c2b3-7b77-4012-85bb-e440204e2775/konnectivity-agent/0.log" limit=1024 Jul 24 12:46:40.709420 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:40.709320 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64599f7bb8-lcz6n_5f413c02-e856-4e04-bcfe-c0588eb831a2/metrics-server/0.log" Jul 24 12:46:40.918229 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:40.918200 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-847z4_ed3578d2-6ac7-42fb-ad7c-eb675775a695/node-exporter/0.log" Jul 24 12:46:40.944817 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:40.944778 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-847z4_ed3578d2-6ac7-42fb-ad7c-eb675775a695/kube-rbac-proxy/0.log" Jul 24 12:46:40.966387 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:40.966311 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-847z4_ed3578d2-6ac7-42fb-ad7c-eb675775a695/init-textfile/0.log" Jul 24 12:46:41.410727 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:41.410691 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-l4wz9_28281cb5-b0f5-46cc-bdc1-4845cd5ac4df/prometheus-operator/0.log" Jul 24 12:46:41.444043 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:41.444016 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-l4wz9_28281cb5-b0f5-46cc-bdc1-4845cd5ac4df/kube-rbac-proxy/0.log" Jul 24 12:46:41.487566 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:41.487538 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-xkrw6_21eff492-62c8-43b3-b1e8-7a1b8df7a343/prometheus-operator-admission-webhook/0.log" Jul 24 12:46:41.524931 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:41.524905 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f989ff447-gv6z9_b53aaad3-a378-4216-8da4-cfbdb9426d5b/telemeter-client/0.log" Jul 24 12:46:41.556360 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:41.556332 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f989ff447-gv6z9_b53aaad3-a378-4216-8da4-cfbdb9426d5b/reload/0.log" Jul 24 12:46:41.589474 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:41.589437 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f989ff447-gv6z9_b53aaad3-a378-4216-8da4-cfbdb9426d5b/kube-rbac-proxy/0.log" Jul 24 12:46:44.069680 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.069645 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74d499666c-kq6tk_64de5b22-fc66-4e1a-9a37-52f78d27bd3a/console/0.log" Jul 24 12:46:44.101152 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.101126 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-76w6r_86fc48b9-c493-4c64-8204-8efa1fec0d94/download-server/0.log" Jul 24 12:46:44.981573 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.981535 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75"] Jul 24 12:46:44.981836 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.981824 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" containerName="gather" Jul 24 12:46:44.981888 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.981839 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" containerName="gather" Jul 24 12:46:44.981888 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.981853 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" containerName="copy" Jul 24 12:46:44.981888 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.981860 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" containerName="copy" Jul 24 12:46:44.981988 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.981926 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" containerName="copy" Jul 24 12:46:44.981988 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.981934 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b602b18c-4402-4f22-8ab2-207c9b0f08a6" containerName="gather" Jul 24 12:46:44.983966 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.983946 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:44.986449 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.986428 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qdxdl\"/\"openshift-service-ca.crt\"" Jul 24 12:46:44.987233 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.987216 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qdxdl\"/\"kube-root-ca.crt\"" Jul 24 12:46:44.987295 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.987241 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qdxdl\"/\"default-dockercfg-xvzg4\"" Jul 24 12:46:44.995414 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:44.995388 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75"] Jul 24 12:46:45.050634 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.050591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-proc\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.050808 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.050650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87wq9\" (UniqueName: \"kubernetes.io/projected/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-kube-api-access-87wq9\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.050808 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.050670 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-podres\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.050808 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.050689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-sys\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.050808 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.050728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-lib-modules\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.151951 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.151915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87wq9\" (UniqueName: \"kubernetes.io/projected/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-kube-api-access-87wq9\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.151951 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.151952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-podres\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.152398 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.151983 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-sys\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.152398 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.152011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-lib-modules\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.152398 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.152100 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-podres\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.152398 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.152120 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-sys\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.152398 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.152140 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-lib-modules\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.152398 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.152122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-proc\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.152398 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.152176 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-proc\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.160341 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.160314 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87wq9\" (UniqueName: \"kubernetes.io/projected/466a10a4-5d50-428e-9fed-9d4f1cb9faa6-kube-api-access-87wq9\") pod \"perf-node-gather-daemonset-cqv75\" (UID: \"466a10a4-5d50-428e-9fed-9d4f1cb9faa6\") " pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.293756 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.293728 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.434263 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.434229 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75"] Jul 24 12:46:45.438254 ip-10-0-134-28 kubenswrapper[2560]: W0724 12:46:45.438217 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod466a10a4_5d50_428e_9fed_9d4f1cb9faa6.slice/crio-5a250c162c2f1b4632ac24efda6c34f0c3a4a36046aa1c9dc60bdfea6845019f WatchSource:0}: Error finding container 5a250c162c2f1b4632ac24efda6c34f0c3a4a36046aa1c9dc60bdfea6845019f: Status 404 returned error can't find the container with id 5a250c162c2f1b4632ac24efda6c34f0c3a4a36046aa1c9dc60bdfea6845019f Jul 24 12:46:45.634809 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.634740 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xtwvj_040af56e-0b89-4bef-884d-ac4b1654161c/dns/0.log" Jul 24 12:46:45.690362 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.690326 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xtwvj_040af56e-0b89-4bef-884d-ac4b1654161c/kube-rbac-proxy/0.log" Jul 24 12:46:45.767302 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.767270 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-chw2x_e967ad27-492d-4e32-9ecf-4c0aaef59570/dns-node-resolver/0.log" Jul 24 12:46:45.916118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.916029 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" event={"ID":"466a10a4-5d50-428e-9fed-9d4f1cb9faa6","Type":"ContainerStarted","Data":"755afb202de5a4cd015f70971ff1dba688ecac2727fe06e37449045e834a5257"} Jul 24 12:46:45.916118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.916079 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" event={"ID":"466a10a4-5d50-428e-9fed-9d4f1cb9faa6","Type":"ContainerStarted","Data":"5a250c162c2f1b4632ac24efda6c34f0c3a4a36046aa1c9dc60bdfea6845019f"} Jul 24 12:46:45.916317 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.916164 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:45.933486 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:45.933436 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" podStartSLOduration=1.933420996 podStartE2EDuration="1.933420996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:46:45.931974432 +0000 UTC m=+554.091290788" watchObservedRunningTime="2026-07-24 12:46:45.933420996 +0000 UTC m=+554.092737333" Jul 24 12:46:46.218515 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:46.218441 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-567b79bcb-4tsr6_7d2251a2-310c-49dc-906e-50cebc635de8/registry/0.log" Jul 24 12:46:46.242671 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:46.242637 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2m8mt_49ab2dab-d7e6-42d9-9133-e0cca11f958d/node-ca/0.log" Jul 24 12:46:47.415333 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:47.415305 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-48scl_dc26c320-d6f6-490a-aa8a-f1bc610fc9ea/serve-healthcheck-canary/0.log" Jul 24 12:46:47.872576 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:47.872546 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4bl7v_0f5d4b71-e854-457a-97b2-dbcbefabe000/kube-rbac-proxy/0.log" Jul 24 12:46:47.896948 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:47.896924 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4bl7v_0f5d4b71-e854-457a-97b2-dbcbefabe000/exporter/0.log" Jul 24 12:46:47.922054 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:47.922030 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4bl7v_0f5d4b71-e854-457a-97b2-dbcbefabe000/extractor/0.log" Jul 24 12:46:49.900040 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:49.899988 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-fsw5x_7fb0f8e9-3691-497d-b78d-0ffb9578034a/jobset-operator/0.log" Jul 24 12:46:51.930818 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:51.930791 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qdxdl/perf-node-gather-daemonset-cqv75" Jul 24 12:46:53.333365 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:53.333326 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-zhqwr_e4550148-fac4-478f-b54f-696d8f6ff55b/migrator/0.log" Jul 24 12:46:53.362146 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:53.362118 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-zhqwr_e4550148-fac4-478f-b54f-696d8f6ff55b/graceful-termination/0.log" Jul 24 12:46:54.827411 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:54.827383 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gd2rn_d104bae1-f9d2-4386-9fed-22d764ba28a2/kube-multus-additional-cni-plugins/0.log" Jul 24 12:46:54.857118 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:54.857043 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gd2rn_d104bae1-f9d2-4386-9fed-22d764ba28a2/egress-router-binary-copy/0.log" Jul 24 12:46:54.879658 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:54.879633 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gd2rn_d104bae1-f9d2-4386-9fed-22d764ba28a2/cni-plugins/0.log" Jul 24 12:46:54.903837 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:54.903808 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gd2rn_d104bae1-f9d2-4386-9fed-22d764ba28a2/bond-cni-plugin/0.log" Jul 24 12:46:54.928850 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:54.928823 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gd2rn_d104bae1-f9d2-4386-9fed-22d764ba28a2/routeoverride-cni/0.log" Jul 24 12:46:54.952018 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:54.951994 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gd2rn_d104bae1-f9d2-4386-9fed-22d764ba28a2/whereabouts-cni-bincopy/0.log" Jul 24 12:46:54.975194 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:54.975168 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gd2rn_d104bae1-f9d2-4386-9fed-22d764ba28a2/whereabouts-cni/0.log" Jul 24 12:46:55.256220 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:55.256193 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-scm8p_6472575c-2d5c-4ee0-a356-5ca8031ff314/kube-multus/0.log" Jul 24 12:46:55.327299 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:55.327271 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ffwf9_c483e782-957b-400e-85d2-5cbd7b4d021b/network-metrics-daemon/0.log" Jul 24 12:46:55.350953 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:55.350925 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ffwf9_c483e782-957b-400e-85d2-5cbd7b4d021b/kube-rbac-proxy/0.log" Jul 24 12:46:56.386678 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:56.386651 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovn-controller/0.log" Jul 24 12:46:56.407722 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:56.407681 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovn-acl-logging/1.log" Jul 24 12:46:56.407722 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:56.407696 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovn-acl-logging/0.log" Jul 24 12:46:56.429130 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:56.429094 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/kube-rbac-proxy-node/0.log" Jul 24 12:46:56.452238 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:56.452199 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 12:46:56.473781 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:56.473756 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/northd/0.log" Jul 24 12:46:56.496930 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:56.496870 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/nbdb/0.log" Jul 24 12:46:56.518699 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:56.518662 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/sbdb/0.log" Jul 24 12:46:56.575257 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:56.575225 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tn6ch_d028afd3-7457-4b29-b004-0ded45442fb8/ovnkube-controller/0.log" Jul 24 12:46:57.933466 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:57.933425 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6ndzc_e20441fc-7657-433e-926c-6c8c707528e8/network-check-target-container/0.log" Jul 24 12:46:58.878861 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:58.878829 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dclw4_f2ec27bc-3ad0-4f18-ae23-80f1f78d7d8d/iptables-alerter/0.log" Jul 24 12:46:59.634294 ip-10-0-134-28 kubenswrapper[2560]: I0724 12:46:59.634264 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-xrqb5_1a448c04-97c9-47f4-8e5a-1c34f783a56f/tuned/0.log"